edCOHEHT BESOHE 



ED 19Q 635 

» ■ 

ftOf HOR 
TITLE 



INSTITUTION 
SPONS AGENCY 
POB DATE 
NOTE 



EDFS PRICE 
DESCRIPTORS 



IDENTIFIERS 



ABSTRACT 



TH BOO 767 

Anastasir Anne; Seisingerr Kurt f, 

Ose of Tests witfi Schooichiidren. final Project 

Report. 

Fbrdham Dniv. , Bronx^^ S,Yi Dept. of Psychology. 
Harcqurt Brace Jovanovich^ Inc. , New lork, N.Y. 
Oct BO 
191p. 

MF01/PC09 .Plus Postage. 

Achieyement^T^sts ; Elementary Education; Elementary 
School Students; Feedback; Inteliigehce Tests; 
Minority_Grdups; _ *Parent Attitt>des; *Stahdar dized 
Tests: *Teache^-A±titudei; *Testing Probleffls; 
♦Testing Programs; Test Interpretation 
*Test Directors; Test Publishers; *Test Use 



How standardized achievement and mental ability tests 
are used in the schools^ and_ what parents and teachers think, about 
such testing r were in vestigated. Guided' in ventories Were administered 
to 207 _t€ach€rs from 1.0 schools and to_223 parents from 12 . 
Parent -Teacher Association grroupsi Intensive individual interviews 
were gdnduqted with 15 testing coordinators with responsibility for 
district -^wide testing decisions^ Teacher inventory covered personal 
data^ testing. activities and use of test scores, test opinions, and 
familiarity' with testing concepts and_ihterpretiv€ context. Parent 
' inventory covered personal data, attitudes toward testing in general 
an,d toward specific, educational uses of tests^r . knowledge about uses 
of tests in own child's schdql^ reactions to own child being tested, 
and extent and nature of feedback received about child's test 
performance* Results ^for teac'hers^ testing coordina tors , and parents ' 
are reported in separate chapters. A discussion section integrates 
^findings from_these parts and presents implications, with special 
focus on testing comfunications at several levels. .Treacher 
inventories^ parent attitude measures, and test coordinators* 
interview questions are appended. (Author/GK)' 



* -Reproductions supplied by EDPS are the best that cait^^be made . * 
* 1 _ ' from the jpriginal document. * 

ERLC 



u s_oei»A»ttMENt<>F heaLth. 

EDUCATION,* WELPASE 
NAtiONAL INSTITUTE OF 
EDUCATION 

.11!?> PQCUMFNT HAS.. BEF.Ki--PEPfi 
OUGE-0 EXACTLY AS WHCEivED rpc 
.THE PERSON OR bWGAKi4ZATiON oRlGl 
ATjng IT POINTS 0_F VI£.W QR OPiNiOJ 
STATEO NOT NECESSARrtY REPR 
SENT OPFlClAL. NAtiONAt i-NSTl TUTE C 
EOurATiON POSITION OR POLICY 



USE t)F 



TESTI 



WITH 



CHOOLCHlLDttfiN 



ANNE ANASTASI aSa KURT F. GEISEVGER 



Fordbam University . "^^Rwission to repropucethis 

MATERIAL HAS BEEN GRANTED BY 



EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



GGTOBER 1980 



PROJECT STAFF 



Principal inveatigator Jtane ftnastasi 

project Director Kurt F. cseiainger 

Faculty Research Associate Lawrence A. Bradley 

Graduate Assistants: 

Vincent Severn * S.J. . 
Cynthia Kabat 
Gardner Locke 
Jean Powell-^irhem 



Secretary: Peggy Mackiewicz 



CONSULTANTS 

AnttionyN. Baratta 
Eileen Byrne 
John C. Houtz 
Jp seph ^ . X McCarthy 
Vincent iM. Nbvak, S.J. 
Lillian' R. Restaino 
Jay S. Sexter 
John M.I Skalski 
Thomas 'g. Viiici. 
John F j Walsh 
Steven IWepner 



iii 



Tfiis p2X)ject was supported in part by a grarit from 
Harcourt Brace ^ovatnovich. Inc., to Fordhaxn University 



OSie opinions expressed in this report are those of 
the autiiors and do riot ref lect^ the views of Fordham 
University or /Harcourt -^Brace Jov€uiovi^ Inc. 



want to express our deep appreciation to the school 
principals, testing coordinators, presidents of Parent 
Teacher Associations, and the many individual teachers 
and parents, t^ose interest aind cooperation made this 
project possible. 



^ ABSTRACT 

The prin«,pai object was to investigate how stauidardized 

_ _ X : 

achievement and mental ability ;tests are used in the schobls, 
and what parexits and teachers think about su^ testing. Guided 
inventories were administered to 207 teachers from 10 sdhools 
and to 223 parents from 12 PTA groups. Intensive individual 
^interviews were condudted with 15 testing coordinators with 
responsibility for district-^ide testing decisions. Teacher 

^ ' . 

inventory covered personal data> testing activities and use 
of test scores, test opinions^ and familiari^ with testing 
concepts and ^tiarpretive context i Parent inventory covered 
personal data, attitudes toward testing in general and toward 
specific educational uses of tests, knowledge about uses of 
test^ in own child's school, reactions to own child being 
tested, and . extent and nature of feedback received aOsout child 
test perfojcmance. Results for teachers, testing coordinators, 
and parents are reported in Parts I, II, 2md IXZ, respectively. 
A discussion section integrates findings from these parts and 
presents implications > with special focus on testing communica- 
tions at several levels. 
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BACKGROUND OP THE STUDV 



^ere are several indications that testing practice may \ ^ 
undergo significant changes ixf^the 1980s (Anastasi, 1976; 
cai. 12; 1979,s,Ch. 2t 19^6; Feuers 1979; Lerner/ 1979, 

1980; Maloney &^Wardr 1976; Messick, 1980; Staats^ 
Some of tiiese changes concern the purposes for wSicfx tests are 
used* such as selection vs. placement, prediction vs. diiagnosis, 
and in^ititutiohal vs, individual decisions. Some will involve 
major revisions in the nature of tests themselves or the 

development of new tests fbliowihg inndvattiye approaches. It 

. ■ _ _ . - _ ■ - 

appears likely^ however* that among the most significant 

changes will be tixose pertaining to the interpretation of 

test results. With the dramatic ea^ansion in test development 

and use since the 1940s, test constructors as well as test 

users have tended to focus more and more on testing technology 

and to become dissociated from the mainstream of behavioral 

science (itaastasi, 1967) . ' — 

Advemces in psychology, genetics ; and other relevant fields 

have not been adequately reflected in the way test scores are 

interpreted and used in the decisions that affect individuals. 

Outworn concepts and models of the development of human behavior 

have survived tenaciously in the interpretation of test scores 

(Cravens, 1978). in th^ 1970s, several te^t authors 2Uid 

ptablishers made feeble attempts to dislodge some of the excess 



meanings that had become associated w±th their tests by rb- 
placing the; term "intelligence" in the test names with more 
neutral terms. But the pxiblic — and all too many professionals — 
stiti retain ah ".IQ" orientation and treat a mental test score 
as a property 6.£ the brgeuiism. • 

Current criticisms of testing by various public interest 
associationB; mihbrity-grbup spokespersons^ and other brgeuiized 
groups stem from a diversity of sources. Political mbtives 
obviously play a large part (Lerner, 1979, 1980). Piibiic 
media axe attracted by the news vaitie of the ensuing contro- 
versies and may create a distorted impression of the prevalence 
bf negative attitudes toward testing. To. some extent, however, 
the critici£;is axe directed against actual misuses and mis- 
interpretatibhs bf tests; and insofar as this is true# the 
objectionattxe practices shbuid be identified and corrected. 
It is the responsibility of bbtii test users {such as school 
systems) an<^ test publishers to take steps tb cbrrect these 
misuses. 

In the 1976s, individual investigators as well as professional 
emd scientific organizations began to examine intensively the 
ethical, societal* and scientific aspects of test uses atnd 
mistises. Their approaches vary widely, ranging from public 
opiriibn polling (Brim, 1965? Brim* Glasia, Neulinger, & Firestone, 

■ . ■ B 



1969; CSoslin, 1967) to historical^^ sociological, and ethno- 
graphic studies (Resnick/ 1979; Reshick & Resnick, 1978; 
Airaaian, 1979; O'Regan, Airasian,& Madaus, 1979) . PsySblb- 
gists from diverse specialties, ranging from experisiental and 
psychometric to social and clinical, have amassed esetensive 

bodies of data oh such problems as test anxiety (Spielbeirger 

Jig- ■ • -_ _ - _ - 

et ali, 1978; Tryon, 1980)^ the effects of tests on students 

(Kirkiand^ 1971)^ test fairness and bias (Ireland, 1979j 

Gross & Su, 1975; Sonter & Schmidt, 1976; Hunter, Schmidt^ 

& Hunter, 1^79; Jensen, 1980, Cha. 9 & 10; Linn, 1978; Petersen 

& Novick, 1976), the effebts of special training programs oh 

test scores (Babad & Budoff, .I974r Budoff & Cormsm, 1974; 

College Board, 1979; Peiierstein, 1979), the role of cultural 

differences in\ test performance (Berry, 1972; Cole &a Bruner^ 

1971; Goodhow, 1976; Neisser, 1976, 1979) , and the iiature of 

the constructs assessed by tests ( Construct VaJ^idity , 1980; 

Messick, 1980) • 

THE PRESENT STUDY 

OM^MC^ives 

_ _^ _ _j 

Tlie major purpose of t^is project was to gather data on 

how tests are actually used with schoolchildren, and v^at the 

people who are closely involved witii childrem know and think 

about tests. Prominent among such people, of course, are 

teachersi (and other school personnel) and parents. An importauxt 



component of current dissatisfactions with testing pertains 
to t^st-uae witii etixnic and cultural minorities. Accordingly, 
we were especially doncerned with how tests are used with 
minority children, and with the views of Sinority parents 
andeducators regarding test use. At the same time, our 
approach was delil^erately broad. Tests can be effectively used 
to bfeefit all children or Qiey can be misused to the detriment 
Of all children. The use of tests with minorities o^ be 
"beat understood - and i&proved - within Uie content of 
test uae witii all children. - • ^ . 

A major hyp5theaia that underliea the present study ia pat 
the communication of test results to teadhers and parents 
leaves much, to be disired. Certain parts of the study are con- 
cirned wiUi this highly specific type of info«.ation transmittal, 
ftnotiier relevant aspect of communic xl:ion pertains to the disse- 
mination 5f general taiowtedge aSout testing and aie meaning of 
teat scSres. Today's teat consumers (e.g., teachers, parihts, 
test-takers) want comprehensible explan^itiona about teating so 
: that they can judge ita value for Qiemaelvea. And this is a 
goal that c^" be achieved, as illustrated by two recent exiles 
of effective printed communications, one directed to the parents 
of schoolchildren (^er, 1980) and one to college-bound high 
ichool seniors (College Board, 1980). There is also need for 
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cdimhuhicatibh in the opposite directioh» naihdly frdro parents, 
teasers, and oQier test users to educatior^al administrators 
and test authors and publishers. Such cipnimuhiGatioh can re- 
veal current misiises 2ind misinterpretat^^ that are undermining 
the appropriate and constructive usey^f testsi 
General Plan 

The present study followed a/ "tiiree-pronged approach to 
explore test use in ttie schools/; with special concentration 
6h^ the elementary school level. Data were col'lected from three 
sets of persons critically with the use of educational 

tests: (a) teadhet^s, (b) xestihg cbbrdihators with major re- 
sponsibility for schboi^tes prbgrams* and (c) parents of 
sdiool^iidreni DataVfrbm teachers and parents were gathered 
through written questiibnnai^s administered by project staff to 
small groups, with^pportunity for discussion at the end of 
each session, information from testing coordinators was obtained 

thrbugh intensive- individual interview:^ conducted by a senior 

- - / -_ - - --- ■' - • ■ • 

member bf the- prbject staff . 

Dhe major questibhs tinder investigation may themselves be 
grouped into three categories, althbugh daita bearing on any one 
category were tatsually derived from more* thcui one type bf partici- 
pant. Firsts We were inteirested in how tests are selected and 
how decisions about testing programs are made. Secbhd^ wia 
wished to explore the puarposes for which tests are used in the 
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aciibbis and the ways in vAiich they cohtriJsute to educational 
decisions ahout individuil ^ildreh. • lliird, we wanted to 
identify strengtiis and ; weaknes ses of'ciarrent test usage as 
perceived by parents and school personnel. ^ 

ftt tihe csutset, it was necessary to address fully and 
explicitly tiii problem oJ protecting the confidentiality of 
project data. Not only 'is this a general ethical ofaliga'^Sn 
in conducting all iciintific research, but it also soon became 
apparent «iat foraal aasurince regarding the strict confidentiality 
of group, identity was a prerequisite for participation in our 
stTady. TWO examples of the type _ of written commitaneht required 
from us are included in Appendix ft. Following the wording pre- 
scribed by the participating official, in oni of these letters 
we agreed »Qiat in no way will any individuiis in your school, 
your s^ooi itself, the stdibbl district, to^, cotinty, etc. 
ever be identified in any way. You will have deplete ahonymity." 
Ih tiie other Upended letter* we promised "that no mention pf 
any bf the individuaii ih^the study, of the school in que it ion, 
br their Ibcatioh,. proximate or general* will Se.made. " It mi^t 
be added that, because of the rather extreme precautions taken 
to protect ttie identity of individuals and ihstitutiohd, we 
were able to bbtaih aensitivfe-data tiiat might otherwise have 
been unavailable to ua. We alao feel free to report our findinga 
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fully, withbtit glossing over \^at >could have been enibarassing 
details. iSxe multiplicity of our data sources served as a 
means of safeguarding the identity, not only of persons and 
schools, but also of ^e various ^publishers ^ose tests werel • 
cited by the respondents. _ i 

Most of our contacts, especially for teacher sind parent 
groups^ were made through the cooperation of our project' 
consultants at the Pbrdham University School of Education, 
\^ose students are drawn from a large and diversifie^i set of 
sdhools^-^btixer contacts with participating individuals atnd 

. schools were made* trough prbfessibnal ^persbhs in varibus schbbl 
systems known^ personally to m^bers of the prbject staff. With- 
in tile limitations imposed by the confidentiality requirement, 
we can report that our data were obtained in a tristate area 
within^ commutdlhg distance of New. York City. ^ The teachers, 
parents^ and testing coordinators were drawn from settings 
representdLng_.a wide range in type of school (public, private, or 
parbchial^ general or special^purposej , typ^ of neighborhood 

(inner-city^ metrbpolitan^ suburban) > income level,, and ethnic 



composition^ 



In tAis report, the methodolbgy 2Uid results fbr thbse parts 
of the study concerned with teachers, testing cbbrdin^tbrs, and 
parents are described in separate sections; in that order. A 



^it^ bxie exception* a school in a large northeastern city outside 
. -axis^area. . - \ ' . 
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fi„^l,:dis^ssionl| section draws f^om all three parts of the 



Study. 

. PART I: TEACHERS 



Procedure 

. ^veldnmeat and Pretesting: 2^ Personnel Invgnt^. 

An instrument for small-group administration to teachers arid 
Other appropriate school personnel was developed, pretested, 
and revised during tii^ first project year (1978-7S) . Pretest 
data were collected f irom io classes at the Pcr^am University 
Graduate school of Education, nine held at .the Lincoln Center 
campus and one at ti.e Tarrytown^ campus. ftU^ but one of the 
classes were in the Curricuiuia Division, Se tenth Was in axe 
^Ministration Division, completed forms were obtained from a 
' total of 124 persons, -flie respondents appeared to be.tj^ical 
of graduate students in a Collie of. Education; the majority 
were curr«itly employed as teadhers, and a sizeable proportibn 
were educational administrators. ^ statistical analyses of the . 
responses, together witil a consiaeration of comments by respon^ 
dents and recbmmindations by project coneult ants, led to th^ 
preparation of tixe iinal fom of the School Personnel inventory, 

in a Liberal Arts college. 



is 
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reproduced in A|>pehdix B-« 

The entire inventory is divided into. four parts: a one- 
page quest iohhaire oh background ihfbrxnatibh^ the Test Activities 
Inventory, ^Se Test Opinion Inventory r amd the Tiast Usage inven- 
tory- . iSe Test Activities Invehtbrv consists of two parallel 
sets of ^questions coverdLng the same information, but with re- 
gard to acdiievement tests in the one and mental abili^ tests' 
in the o-Uier. In both cases, the questionnaire begins with 
a brief characterization of tile l^pe of test under cohsideratijDn 
(achievement or mental ability) # followed by a list of 15 \^ - 
possible activities that a teacher could, perform in relation 
to these tests. %e respondents circle v^ether they perform 

eadi of the ac-tivities regularly^ occasiohally^ or never, A . 

'7' _ ■__ _ '_ \ _ • ■ 

/ final category . covers amy otiier activity performed^ ' 

filled in by the respondent emd meorked for freque^^^^ ttija 

same tray. Each of the two sections of the Teat Activities 

Inventory concludes with a singlef nine-poinl: rating seals, on 

which the respondent evaluates how useful he or she has found 

that type of test^ and two open-ended questions. The first 

question asks what could be done to make the tests more useful; 

~~ the second requests the respondent ^to name one or more specific 

Samples of achievement or mental ability tests, respectively. 

^e latter question was included largely as a check; on what 

tiiese two Go^on test categories meant to the respondent. ■ 
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Thi Test Opiiiidn Ihvetvfe&gy cohisiata of 15 nine-point 
Likert-type attitude items. Each item presents a statement that 
is eithei: clearly favorable or clearly unfavor<sl3le to current 
educational uses of tests, ^ese statements were dravm princi- . - 
pally from opinions about teats ea^ressed in the media or iii 
paier popular discussibh Of tests by individual spokespersons 

! or orgamized groups. We were= interested chiefly in obtaining 
reactions to adverse criticisms about teat use, and accordingly 
nine of the 15 statOTents were of this type. In order to _ 
minimize the operation of an acquiescerice responae set (or ita 
reverae), and to ensure t&at each atatement waa carefally read 
and evaluated independently, we inserted aiae atatementa favorable 
€o teating. Theae atatement a were placed firat and laat in the 
iiit and in four., intermediate, randomly diatributed poaitibna. • 

^e feat Uaage ^Eavehtorv was designed to aaaess teachers' 
uSderatandihg of certain basic teating cbndepti, as well as their 
familiarity with relevant behavioral knowledge tiiat would affect 
the interpretation and use .of test acores. in ita preteating 
atage, thia iiiventory was analyzed in terms of internal consiitency 

. {coefficient- alpha), iteS^ difficulty index, item-teat correlation 
(corrected for item effect on total adore), and prOjportion of 
peraoria selecting each option. On the basis 6i the pretest data, : 
several items were deleted, the options of other items were revised, 
and new it«ns were added. TBie final version consists of 15 f ive- _ 
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option multiple-choice items, with a "Don't Know" dptibn in 

1 _ _ _ ■ " ^ • X. . . '•j 

fifth poaitibh. : 

Data-<3aaierinq Procedures . The School Personnel Inventory 
was administered by a to^ber of the prbject staff to teachers 
from 10 sdfaooli. Ail were elOTentary schools^ except for one 
junior high school from whi^ we obtained only nine teachers. 
The schools included eight public schools and two religious- 
affiliated private schools. A total of 207 completed inventories 
were obtained^ the number from each scjibbl ranging f rbm 8 to 38. 

The ■^picai sequence of steps fblldwed in gathering data 
from a s^ool began wi^ a telephone call to the school principal 
whose name had been obtained through one of omt referral -sources. 
This call usually led to a meeting with the principal in his 
or her of fice ^during Whi^ a project staff mCTdber explained the 

nature auid purpose of the project^ outlined the benefits the 

-1 ■ • 

schob] cbuld- deriVia from participation, zmd discussed ^e 

: .: _. _ _ _y 

arrjmgements for- protecting confidentiality* In some cases, 

at the principal's request, a! similar meeting with the district 

superintendent followed. Next came more phone calls to settle 

on a data for actual data gathering at the schbbl, aiid in some 

cases the st&mission df'letters formalizing the confidentiality 

arrangements. The Sdhool Personnel Inyt^ntory was administered 



"^Sihce two of- the schbbls had a single principal and regularly 
held joint faculty meetings#'59 teachers from the , two schools 
were tested in a single session. ..^ 
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during a regularly scheduled faculty meeting at each school... ' 
•]^picaxly, tie project staff member addressed the faculty for 
16 to 15 minutes. regarding the nature and purpose of tne project, 
and then administered the inventory. Bie session ended with an open 
discussion of any questions the participants wished to raise. 

After the completion of data analysis, in October 1980, 
each' school recexved an individually computerized report of 
its own da;ta, together with the overall project results on the 
School Personnel Inventory and an invitation to contact the pro- 
ject staff if further discussion of the report was desired. 
Participant Gharac^r is^cs 

The one-page questionnaire included in the School Personnel 
inventory provided the data for the description of participant ; 
characteristics st^arized in thii' section. These data cover: 

(1) demographic dSaracteristics of tiie teachers themselves, and 

(2) * information regarding the extent and nature of student con- 
tacts tiie teachers had in their normal scliobl activities. 

Bemoaraphic Data.' TiSie 1 st^arizes the personal characteris- 
tics of the 207 teachers v^ho participated in this portion of 
the study. The sample was predominant iy female (81%). The 
largest proportion were in their 20s and 308, but about 40% 
were distriiauted through the 4bs and 50s, and S% were 60 or 
bver. Ethnically, the large majority were vSiite ' (non-Hispanic) , 

with 1396 black and only 1.596 Hispanic, Educatibnaily, the . 
largest group (3896) had a Master 's degree plus some 
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Table i 

Teacher Sample: Demographic Data 



Variable 


■ 


Percentages 




Sex 


Female 


80.8 


Male 


19.2 


:S.ge , 


20—29 


27.0 


50-59 


1 Q ^ •] 
±7 .3 




30-39 


29.0 


60 & up 


O A 




40-49 


21. S 






■ - J :^ : ■ . 


White (hon-Hispemid) 


84.1 


Hi spzmic 


1 - ^ 


I - 


Black 




fimsir . Xnc3 xan 


U 




priehtal 


0 


Other^ ^ 


1.0 


■ CiUuCClUlOIi 




3.4 


Master degree. 


18.8 




Bachelor degree 


11.6 


Master & further 


37.7 




Bachelor & Graduate 


28^5 


Doctoral degree 


0 


• bating 


Graduate course 


42.9 


Grad & In-service . 


4.4 


Training 


yxidergrad. course 


20.7 


Undergrad & In-service 


4.4 




In-service 


3.9 


Gr eKi i & Undergr i &^ln-serv i 


6.4 




Gfad. & Undergrade 


6.9 


No formal training 


10.3 


Reported 


Classrpcin tezicher 


67.2 


Teacher/Adinini st r ato r ^ 


2.5 


,-job title 


Special educ. teacher 


20.2 


Administrator 


2.5 c 




Specialty teacher 


4.5 


Social woricer^ 


2.0 




( e • g • » reading math } 




Nttrse^, 


1.0 



a . ^ . 
For item responses^ N=200-207 



b _ _ . _ 

"1 East Indian, 1 Filipino ( • • 

\ • ' *■ ' • .. ;. 

c , . ; . \. - 

Served on Child Study Te^s assessing individual students on basis of 
test scores and otiier data. 
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further graduate work; another 19% reported only a Master's degree 
while none had a doctoral degree, A bachelor's degree plus 
some graduate work accotmted for another 29%. -A relatively 
small proportion (12%) had only a bachelor's degree, and 
a. few (3%) reported still less education. On: the whole, the 
■ edudational iave.1 of this group of teachers -vas high and 
fairly typical of that found in large school systems in urban 

2Uid suburban areas. 

Of more interest for the present study is the extent of 
training iri educational and psychological teiting. The largest 
proportion (43%) had had only a graduate course in this area, 

' '* ■ * - ■ _ O 

and the second largest (21%) reported only an undergraduate 
course, pdw (4%) reported 5nly in-service training on testing.: 
various combinations of two or all three types of training, were 
reported by 22%. Only 10% had received no formal training in 
educational or psychological teatiiig. With regard to current 
job title, tiii-iample was composed predominantly of classroom 
teachers (67%). An additional 20% were special education 
teadhers, and w^re teachers of subject-mattir specialties, 
such as reading or Sathematics; 5% were functioning as adminis- 
trators or teadher/adSinistrators. The sample also contains 
four social woi^kers and tWo school nurses, ^eae indi^^idiails 
were included because they iirved on Child Study teams and^^ 
hence had considerable ea^erience in the utilization of ^teSt 



resuiti. in assessing individual di:udeht:s and making recbihmeh-- 
dations ^out educational plac^ent and adaptive instructional 
prograins. \ 

Student Acontacts , Nearly the entire sample (98%) reported ^ 
having direct ^ohtact with students in their daily work. The 
c^rade level ranged from pre-kihdergarteh through high school 
but the grotap taught predcmihahtly at the elementary .grades^ 
witii the largest ni^^er clustering at grades 1 through 6. The 

4' _. ^ _ _ _ ^ ._ __ 

number o£ sttadents witii whom our. paurticipahts had direct contact 
rsmged widely. The extr^es o£ ze^o and several hundred were 
repj^esehted by administrators, specialty teachers, and o^er 
persons with special assignments. The distribution is highly 
skewed, with clustering^, well below the center of the range and : 
a median of approximately 34 students. * 

Tirith regard to ethnic distribution, of students, the large 
majority of participants had contact with predominantly white 
(non-Hispanic) groups of students. The median hxamber of students 
in tiiis category ^s 23.!5r v^ilei the mediaui nuniber o$ black 
students was slightly over 2. The hvraber of black studm ts 
reported by individual respondents, however, vzuried widely, 
ranging from zero to 200. The median ntimbers of students in 
other ethnic groups were all under 1, but the individual fre- 
quencies also revealed wide diversity -among respondents. For 

^Aithbta^ we did not gather data in any senior high school, some, of 
; otar participants incltaded high achddl students, among others, in 

their reported student contacts, because 6£ special assignments or 

teaching at more aian one grade level. o. 



Table 2 ^ 
Stiadent Contacts 



Variable 

Direct Contact 
Grade Levels / 

NtmdDer of students^ 

Mdn N in Ethnic Groups^ 



Response Summary 



Yes i 97.6% - _ NO 

..K ^ *pre-Kindergarten to 12 



2.4% 



Mdn =33.5 

^ite ^23.5 
Hispanic 0.30. 
oriental 0.19 

c 



Range 0-750 

Black 2.43 
amer.Ihdian 0.003 
baier 0.02 



200 responses 



^ '190 resE>ohses 



5'? 
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exconple^ 118 teadhers reported no contact with Hispanic ■ 
students, but 18 teachers reported contact with 6 to '33 Hispanics. 
Similatriy, 138 teachers reported no contact with Ori&itals, 
but 14 teasers reported contact with 6 to 20 students in this 
ethnic category; in suimnary, ^iie tiSe majority of bur partici- - 
pants had sc±iodr contacts wii:h predominantly white (non-Hispanic) 
students, there \^s a atibstSLhtial nuznbex:\ o£ individual partici- 
pants who had experience with ethnic minorities in their normal 
sdhool activities. / 

Total^Group Results 

Teacfaeri ' Perceptions of Adhievemeht and Mental iHDi litv 

iesta. In soliciting teacher responses regarding both uses aind 

« ■ .. . 

evaluations of standardized tests, wo have separated achievement 
from mental ability, tests throughout the inventory. We reached 
this decision because of the prevalence of this /distinction 
in educational usage, regardless of its theoretical weaknesses. 
Several of our findings corroborated the need/ for such a differen- 
tiation wtiBTi seeking information from teachers. At this point, 
let us examine the teachers' responses to tiie open-ended question 
calling for bndVbr more examples of standardized achievement 
tests witii wixich "Se respondent had re^^^tly been involved, and 
the corresponding question regctrding/mentai ability tests. The 
tests named by the rMppndents provide a clue to their per- 



( - ■'- ■ - ■ - ----- • . 

ception of tests belonging in these two categories. 

The general results indicate a clear distinction that 
follows" the traditional pattern. Among the achievement tests 
liste^f^re su^ weil-knowi batteries as the lowa. Tests of 
Bake Skills. SEA achievement Series. Stanford. Metropolitan, 
and California Achieveiient Teits./ in order of frecjuency. 
Diagnostic tests were mentioned /^specially often, the moat 
coiraon examples including Wbodcock-J^hnson KeyMath Diagnostic 
Ariaraetic Test* Peabody Individual ftaiievement Teat* Jind Wide 
Range A^iev^ent Test, as well as the diagnostic parts of ^ 
previously mention^ tatteries. A sizeable group of rei^^lHents 
simply mentioned "criteii5h-referenced tests ." without^icifying 
particular instruments, ^ere were a few individual^nfusiohs. 
sudi as one respondent' niming the Stan ford-Bine t^d one ttje WISC. 
but these instahcea were rare. Nearly all reii^ndents listed 
teats traditinnally classified i?t the achievement category. 

Among examples^ mental ability^sts. the well-known 
intelligence tests'^ clearly topped^e list, with WISC-R. WPPSI. 
and stanford-Bihet accounting icTr 62 reaponiei. Among group - 
testa, the Cognitive -AbilitiM ^Teat was cited most often. Othera 
named" by tii^ee 5r more r^pondenta included aoSe of the SRA aeriea 
the Detroit Teata 5£/1taarhing Aptitude, and ^the 'otia-tehhon. The 
concern, with teai^g diiabilitiea is r-Sflected in the incluaioh 
of the Illi^^Test o£ Psy<2ho linguistic Abilities, the Sloaaon. a 
^ . ■ OK 
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tha Bender Gesta^.t. laiere is some indication that mehtar ^, 
ability tests tended to be identified with individually ad- 
ministered* clinical instruments. For instances, several persons 
" listed the p'lAT and tiie WRAT^ as mental ability tests — of 
course^ the PIAT may have been* confused with the Peabody Picture 
Vbfiabtiiary Test., vdiich others also listed, again, however^ we 
can conclude ^a^^ apart from a few individual confusibnia* the 
large majority of our r^espondehts shared the traditional per- 
ception of a mental ability test. . ' ' 

Tea^itera ' Roles with . Regard to fes_t3,> Table 3 sxasiimarizes 
the involvement of teachers in testing ftanctibna, as well as 
the way teachers use teat scores. For both achievement and - 
mentsil ability tests > the table shows the percentage of teachers ' 

•_ _ ^ _ _ __■ • 

reporting^ that they engaged regularly, occasionally, or never in- ^ 

each test-related activity. It is evident that this involvement. 

- - . - ^ - ^1 - - - - - ■ 
was much greater with achievement than with mental ability tests. 

The percentage, reporting that^ they regulairly pejrformed each 

listed activity is consistently greater for achievement than for 

mental ability tests. This difference applies not only to such 

functions as the selection or administration of tests, cbut also 

to the uses of test scores for each cTf the specific purposes listed 

in Table 3. - ^ K . 

♦ ■ . ' - - * . 

There is nevertheless considerable correspondence* across 

- • a ^ ■ 

both types of tests in the relative frequency with/Which. each 



Table 3 • 
Percentage bt Teachers Reporting Each Teat Activity 



Activity 



Achidvemeht Tested 



Regular iy Occasionally Never 



Mental Ability Taats^ 



Regularly 



Occasionally . Neve 



Authorise testing program 
Select tests 

Coordinate^ niahage Program • ^ 
Decide to continue program 
orient stadcnts to teats 
?(dmihiater teati 
Rocoiye test scores _ 
Have access to scores. 
Use scores i understand students 
ilse scores t instruction 
Di«.sco£Qlj grouping students " 
*9oresi evaluate performance 
Use scorbsi identi^ special needs 
Counsel atuddnts re score 
Explain scores I pafenta or bUiers 
Other uses 



/ 



10.4 
14.4 
19.7 

ip.9 

44.1 
59.3 
72.1 
60 .3 
56.3 
53.4 
41.4 
46.5 
55. 1 

2q.5 

37.1 
12.4 



i6.4 
19.4 
15.3 
12.4 
30.7 
26. d 
17.4 
11. Q 
34.3 
36.3 
43.3 
37.1 
34.6 
34.5 
43.6 
i4.2 



73. i 
66.2 
65.0 



25.2 

11. a 
ia.4 

7.9 
7.4 
10.3 
15.3 
14.4 
10.2 
45.0 
19.3 
63.4 



6.6 
5.7 
9.9 
6.7 
20.2 
22^6 
49.0 
56.0 
35.1 
29.5 
23.2 
23.8 
32.6 
6.B 
17.3 



7.8 
5.7 
. 9.4 
7,2 
10.7 
20.7 
24.2 
23.8 
41.2 
42.0 
40.7 
40.9 
39.9 
22.3 
32.5 
10.2 



65. 
B8. 

80; 
86; 

.61. 
56; 
26; 
18. 
23. 
26. 
36. 
35. 
27. 
68. 
50. 
81. 



^ N-201 - 205^ but "other uses** N-153 
^ N-191 - 193, but "other uses" H«137 
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activlty is regularly performed. The most frequent teadher 
roles reported |or both types ok tests , are: (1) having access 
to scores, atnd (2) receiving scores routinely. Administering 
tests ranks Vthird for achievement tests but drops to eighth 
place for mental ability tests, ffiis discrepancy is under- 
stahdaQsle since, at least in aone of the pi^blic schools; 
within our sample, group intelligence tests are not used. Hence . 
the mintal ability tests would be individual tests tiiat teachers 
are' hot brdiheirily trained to .administer. ; | 

Among the uses of test scores, the relative frequency re- 
ported for the.;twQ types of tests shows close corijespondence. 
The most . cbraion uses for bbthi in order of frequency, are 
as an aid int uhderstanding students > planning and adapting' 
instruction, grouping students for instructional purposes^ evalua- 
ting individual or group performance, and identifying <ihildreh 
with special needs. Also among the ten most common teacher X 
activities, for both types of tests are orienting s tridents to 

' ; i , , _ _ _ ._ . _ . ■■ : , 

taking tests and eocplaihing scores to parents or school personnel. 
Counseling students about scores was not common, but was reported 
by relatively more teachers for achievement than for mental 
abiiit^ tist^ Relatively few taachejrs reported decision-making 
responsibilities regarding testing programs or specific tests. 
Similarly, few were involved in the coordination or management. 
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o£ a testing progranii : ^ ^ 

If we compare the percentage of-'^teachers reporting each' . 
tea^Wivity regularly or occasionally, we find that, for 

Uiev^ent testa, more teachira .engage in theae activities 

I t I ■ ■ ^ _ ------ 

ok aUpgulif than on ah occaaibnil basis, especially for the • 

hLh frequency functions. A clear reversal of this .tendency, 

holever, is found in the uses of mental ability acorea. For 

allW uaea (last eight items in Table 3), the percentage ia 

cbna^tentiy lirger for occasional than for regular. Theae 

diiferehces are underataiidable inabfar aa mental ability teata 

(and eapecially individual intelligence testa) are likely to 

be given only in special daaia and for apecial purpoaea. 

±t will be noted that the last item in Table 3 refers to 

"otiaer: uses, " not listed in tiie. table. This item was marked by 

153 respbndehta for achievement tests and by 137 for mental 

ajsility testi. With rare exceptions', the uses apecified could 

be substaned liidir one or another of tiie tabled categories 

and often represented specific illustrations bf a listed use. 

■ ' • - V- 

It is alsb noteworthy that, with very minor exceptions, the 

same supplementary uses wire submitted fbr achieveSent and mental 

Sility teata, although ^e frequenciea were again higher for 

achieyenient teata. The Soat common usea were mentioned about ■ 

^ice aa often for achievement aa for ability teata. Nevertheless, 
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the relative frequencies of the corresponding uses were in 
the . same rank order for both types of tests • The most common 
/was the use of tests in individualizing instruction and in' 

■. ■ - .- ■ - - - - -. • 

writing Individualized Educational Programs (lEPs). Next in 
ord^r was placement^ especially for the handicapped and the 
accelerated, ^is was followed by pleinhihg instruction and 
treatment, and by identifj^irxg. tiie learning disabled, mentally 

retarded; auid gifted stttdents. it can be seen that all ^ese 

----- \ . . I : 

uses are closely related to each other suid to some of the 

categories listed in Table*. 3. Explaining scores to paurent, or 
child*, or both vras listed by three respondents for both types of 
tests. Two uses* each listed by a single re8£>bndent for 
^adhievtameht. tiasts only were "to support grading" arid "to deter- 
mine awards." it is apparent that the write-in responses on 
test activities served dhief ly to provide specific examples 
and corroboration of tixe results ammaxized in Table 3. ^ 

Perceived Useftilness of Standardized Sests. Table 4 
summarizes Idie findings from the first of tiie nine-point rating 
scales used in several parts of the study. For each scale, 
respondents are instructed to circle the one number that 
corresponds to their judgement. In ^ this case, they are asked 
to indicate how useful they have found standardized achievement 
tests )in one scale^ and ability tests , in the other. The scales 
range from "not at all useful « (1) to "highly useful". (9) . 



Tablb 4 >_- _ 

ieacher Ratings of Usefulness of Standardized Tests 



Type of Test 

Schievement 
Mental ability 



Meem 

5.11 
4.47 



SD 

2.03 
2.16 



Range 

1-9 
1-9 



.14 
.16 



• '-25- . 

Reference to Table 4 shows that opinions varied widely for 
both types of tests i The full range of the scale was used 
(1-9), and the standard deviations of the ratings are approxi- 
mately the same for achievement and s&ility testis Mean ratings 
are close to the center of the scale (5), but opinions tend to 
be slightly more' favorable for achievement thetn for ^iiity 
tests, the difference averaging about half a point/ While not 
large* this difference is significant at p<.6lj > 

Following each rating for nudged usefulness, respondents 
were asked "What could be done make these tests more useful 
to ypu?" ih response, 92^ persons submitted one or more/sugges- 
tions for acdiievemerit tests arid 22 did so fo^ ability tests. 
Again tiiere were several caa^oit responses for both t^^jpes of 
tests, although )wi til lower frequencies for ability tests. It 
is of particular interest that recommendations reg^ding the 
improvement of feiedback had the highest frequencie's for both 
types of tests. Specific suggestions in. this category included 
further breakdown of scores; the us^ of simpler, clearer 
language for explemations^ to teachers, students, and parents; 
suid receiving the test results faster and earlier^ Another, 
delated set of ccnmaents, called for more expleuiation of the 
tests themselves, tiieir meaning and coverage. Still other 
comments submitted by several respondents for both achievement 
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ind. ability tests concerned the need for updating and for 
iSp^oving the validity and appropriateness of teats fbi their 
uses., several recommended the use of tests in conjunction with 
other sources of data about the individual. There were requests " 
for more flexibility, in the use of test results, greater access 
to scores, more psychologists and other trained personnel, 
and proper testing conditions. 

Some recoSendations were Specific to achievement tests. 
The largest number referred to the need for testa geared to 
special populations with regard to their procedures «d materials 
Othe^ recommendations were for tests .pore appropriate for the 
sdrSol aurriculum, and for more teacher input into test content, 
some respondents wanted less culturally biased tests, and some 
wanted more criterion-referenced tests. Along the same lines, 
more prescriptive feedback to aid instruction was recommended. 
Ih reference to ability tests, one respondent suggested the 
teaching of teat-taking strategies. 

^est opinion inventory . The iteins in tiie Test Opinion 
inventory were drawnfrSSa collection of adverse atatementa 
about ,te^s>J«illed: principally from the m^a. and fr^ the 
literaili^ distributed by antitist activist groups. The final 
set iricludes 15 statiiients, among which were inserted six state- 
ments favorable to tests, in order to encourage careful reading 
arid minimize the operation of a generalized response set. Each 



Table 5„ 

Teacher Responses -to Test Opinion Inventory' 



Iteiii No. 


Kev Tdfiic 






* 1 


' Ability tests help instruction. '■ 


4.43 




' 2 


Testing arid' human dignity. _ , ] 


3.22 


2.13 


3 


' Interviews vs. .tests in college; admission. 


6.26 


2.06 


4 


Testing too' widespread in our society. 


6,28 


,2.13 


* 5 


IQ tests and instructional decisions. ' ' 


4.48 . 


2.15 


6 


' Tests underpredict minority school achievement. 


6.28 


2.20 


* 7 


Reading tests aid teachers. 


6.13 


1.95 


8 


Tests measure rote memory.: 


4.62 


.2.11; 




Test scores indepenaent or appearance. . 


4.83 


.2.32 


* io 


Tests, cultural handicaps,and remediation. 


4.30 


2.42 


u 


Mental ability tests unfair to minorities. 


5.59 , 


2;52 


12 


Eliminate all standardized tests in education. 


:3.62 


2.35 


13 


National norms encourage competition. 


5.05 


2.52 


14 • 


Measuring only^ a few traits is harmful. 


5.33 


2.42 


* 15 


Proper test use prevents unfair discrimination. 


6.37 


2.00 



1 

u 
I 



Note . Scale ,1-9, obtained range 1-9 for each item. Low scores indicate favorable attitude, except 
on starred items, 

. V . . ^ _. . ' • , I t. 

For item responses, N=198-204. 
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statement' is rated on, a nine-point scale ranging from "Strbhgly 
Disagree" (1) airough (S) to "Strongly Agree" (9). TiSle_^ 

5 shows the meauis and standard deviations of the ratings given 
to each statement. Lbvi^cores indicate a favorable attitude 
toward tests, (i.e. ^ rejection of ari adverse statement), except 
for the six starred items, in which high scores indicate a 
favorable attitude, ft middle or neutral position corresponds 
to a rating of 5. since &e standard errors of the obtained 
means rangta from .14 to .18, a conservative estiSate of a 
statistically significant deviation (p<.dl) from a theoretical 
value of 5. is indicated by a difference of approximately + 0.5 
or more.. Accordingly, we shall examine items Tf^Siose means fall 
outside the. 4.5 to 5.5 range. 

. Firsts we note the wide range of individual differences in 
the responses. For eadh statement,, the ratings assigned by 
individual respondGnts cover the full scale range from 1 to 9. 
Thp SDs vary from 1.95 to 2.52. Turning to the means, we find 
four aiat do not differ significantly from the neutral value 
of 5 (Items 8, 9, 13, 14) . Four show favor^le reactions to 
tests. Each of these yields a substantial deviation from- 5, 
their means falling below 4 or above 6. Two represent strong 
rejections of extreme antitest views, ^one labeling testing 
as an insult to human dignity (Item 2), the other advocating the 
elimination of all standardized testing in the educational jsystem 



(Iteiti 12) i"" The other two show strong acceptance of positive 
statements about tests, one referring to the usefulness of 

standardized reading tests. (Item 7) , the other to the value 

- - _. - o 

of ^properly used tes-ts in preventing unfair discr imin ation 



(Item 15)^ 




Seven means suggest unfavoraSle reactions to tests. Of 
these, three represent weak rejections of positive stat<^exrbs 
(Items 1, 5, to), with: means slightly below 4.5 (4.30 - 4.48). 
One represents a weak acceptance of an adverse statement (Item 
11), with a mean barely above 5.5 (5.>59J. The remaining three 
mean ratings indicate strong acceptance of adverse statemcuits, 
all falling above 6.25. TJhese. thred items state that:, in -the 
admission of cplle^ge students, interviews should receive more 
weight than tests (Item 3); testing is too widespread in our 
socie^ (Item 4) ? and testa tend to xihderpredict the school 
achievement of minority cliiidren (Item 6). It is noteworthy 
that these stat^ents are not among the moat extreme statements 
in the inventory, nor the most extreme- views encountered in 
the media. 

In general, it appears that this highly heterogeneous group 
of teachers responded in a thoughtful, careful manner. While 
endorsing several adverse criticisms of tests, the majority 
view was moderate. Moreover i the response pattern was balanced 
and meathiiigfui, ^with rejection of the most extreme assertions 



/ , ■ \ 

al^d. endorsOTent of tie ^ore moderate. Theri~^ta-a.^a^ indica- 
tion that the reapondents differentiated between pro^r and 
s^prbper uses of tea^a, and were more -strongly opposed to 
stential or' aasuffled misuses^ 

Familiarity wiai ^eat Conaipts and I nterpre tive Backcyround 
The 15-item/ ntuliiple-choice test laSeled/"Test Usage Iiiyentory" 
was deai^id to (eaeplore teachers' knowledge: ^^out the meaning 
and interpretition-of test s^e^ Each item is in the form of 
a realistic question about/the implications of a test 8c5re, 

; . ■ y . _ 

which could arise' in;a"^diobl setting. Pour response options 
ard given for eac^itei, plus a f if «i "Don ' t Know" option. 
Apart from/S^iing Icnowled^i about tyi»as of scores, norms, 
reliaiaility, and other elCT«itary psycaiometric concepts , we 
wi-^interested in assessing ttie prevalence certain popular|r 
iiaconceptions regarding the" interpretation of "feest scores ^and 
tiie functions of tests. , \ 

As seen in Table 6, the'xaean number of items correct was 
7.74, or slightly 6ver 509&. Inspection of the percentage of 
perjsons choosing each response option shews that every wrong 
bptioii was chosen by s^eone, with a single exception: Option, 
d, Item 10, was rejected by all respondents. This response 
bption claimed that an intellectual difficulty attributed to 
piit environmental liandicapa will be outgrown after the child 



V . iTablo 6 . . 

Tdaclier Knowiedge o^ut Tost concepts ajtd Ihterpretatibha 



item NO 



' 1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
IS 



Central Idea 



Error o£ measarement and leora bands. 

Naed for norms in intorproting numerical score e 

Hatiire of criterion-referenced tests. 

Meaning of grade-equivalent seoresv* 

Moaning of age noma^. ■ i . ' 

Need for supplementary infbrmatioh. 

Nature of reading readtiieai tests« 

Probabiiitjf^ of individual exceeding median of 

bverlapi^ing distrtbution. 
How norms are established. 

_ __ • •_ _ . _* ■ 

Environmental' handicaps and test scores. 

Meaning of standard scores. 

What roeh/tal ability tests measure. 

Meaning of percentile scores* 

Meaning of test reliability. 

Interpri^£ation of grado-eguivalent scoria.: 



^^rGo^^ta2^^_^he^jsijj2t, 



7.0 
4.5 

- 34.5 
1.5 

10. b~ 
1*0 

17.0 
6.3 

[Mm 

2.0 

ii.7 

[23. 4| 
19.1 

1.0 



18.6/ 
30.2 
4.9 
3.0 
|66.0| 
^•5 
4.0 

mn] 

14.4 

39.1 
11.9 

3.5 
t.6 



^ ^ 2.5 

5.9 ISO.Ol 
l.d |42.4| 
|66.S| 19.2 
^ 4.0 , 7.5 
|85.6| 1.5 



Mean Nuniber of Items Correct •> 7.74 



|59.5| 3.5 

3.1 5.2 

l.S 3.0 

36:. 8 0 

14.2 ' 1 17.3 I 

5D.7 3.5 

2.0 16.6 
21.5 . '5.0 

1.5 180^1 



13.1 

9.4 
17.2 

9.9 
12.5 

5.5 
16.0 
49.2 
16.4 
19;.9 
.17.7 
10.5 
18.6 
12.5 

8:.5 



I 



^ote. Correct responses are boxed 

Response Option e * Don't know 
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' is placed in a normal sfchool; environment. We can be thauikful 
1 • for this bit of undisExuted insight airoughout our sampled 

, Turning now to ttie' correct options i we find that the largest 
percentage of respondents chose tihe correct 'option fo^ ail 
itins except items 11 aund 12. 15ie first reveals only la,clc of 
Icttowledge and an attempt to fill the gap with a plausible 
sounding option: Qie leirgest percentage chose the option that 
defines standard scores as scores ohitadLned with standardizeqL 

_ _ . J _o :_ - _ 

.tests*. The s^i^nd has more serious implications. Half the group v 
chose as the acceptable correct ..answer the statement that mental / 
ability tests measure "tuider lying capacity for mental functionincr^ 
^ This one error ^' in pur opinion/ provides the key to several 

; findings in the rest of our study. The acceptance of this 

erroneous survival from the early diacadea of the century would 
certainly lead to the rejection of certain test uses and to the 
endorsOT^ht some of the test criticismjES found in the preceding 
section;: . ' • , ' • 



The laargest percentaige of correct^ ^^swers yas given to 



.1 



Item 3.5 r dealing with 1±lb meaning of grade-^equivalent scbxrea — 



Whose use, alas, psycflhiometricieUis have -been trying to discourage 
for mXy years because of their^ t^^^mical faults. The second 
largest percentage of correct choices is found on item 6, 



i i 



which Gohcems the need for Supplementary, information in inter- 
preting test scores (somewhat obvious^ but gratifying) . More 
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than half the group also chose the correct 6pt±6h, in descending 
order of frequency, for Items 4 (grade equivalents againlj, 5 
(age norms)* 9 (how norms are established), 7 (what reading 
readiness tests should measure) > 1 (implications of error of 
measurement and score bands}* and 14 (teat reliability). The 
percentage of persona correctly answering the remaining seven 
it^s rcmged; £r^ 1? ,t6 50. The percentage of teachers who 
marlred >Uie ••Don't Know" option ^ ranges £r6m 5.5 for Item 
6 (need for supplementary infbrmatibh in interpreting, teat, 

. _ _ _ _ __ _ _ _ _ ; v_ _ « 

sGorea) to 49.2 for Item 8 (probability of individual exceeding 
medieui of overlapping distribution).^ 

■ : '__ '_ - ^ ^ / ■ ■ 

In summary, this sample of widely diversified school teachers 

' , . ! _ * •■ - . ' * 

_^ ,_ ' •_ ' ' ' _^ ^ ■ 

demonatrated many; gaps in their understanding of basic paycho- 

metric and paycho logical knowledge required for the proper inter- 
pretation, of teat scores. They also revealed evidence of the 
acceptance of at leaat one serious popviicu: misGdiiceptidii SLbotit 
what "intelligence" or mental albility testa meaaure. In view of ^ 
the fact that all but 10% reported aome formal training in 

; •■' • » " 

r ■. _ _ " ■_ J. 

educatiqhal or paychb logical teatihg (Table 1)^ theae findinga 
do hot apeak well for ^the ef fectiveheaa of their training. 

Ahalvaia of Total Scbrea on Te^ Opinioh Inventory and Teat 
Uaage Invent©^. In the development of both the Teat Opinion 



Prom one to aix peraoha marked two -optibha on a few items?' these 
respondents were hot credited with a correct response > even if 
marked, and have beeh ihcluded ih the ^"Dbh't Know" percentages 
in Table 6. 
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inventory and Uie Test Usage ihvintory, our object was to 
in<ilude k^s that operationalized a broad-based construct, 
defined as attitude toward the use of standardized tests in educa- 
tion, in tiie: first case, and knowleage retired for proper /. 
test interpretation, in the second. We did not se^/ high degree , 
of item homogeneity within either inventory. Rather, we en-^ 
deavored to span a "wide diversity of specific item c5ntent 
ind situations. By aggregating items heterogeneous in all but 
^e behivior of interest, we can Obtain a total score tiiat 
assesses the defined construct. Whatever empirically est^iished , 
behavibral consistencies remain in Qiis aggregation constitute 
.the trait «iat is measured. In this regard, we are following . 
the'^roach'recb^ended by Humpireys (1962, 1970) in the ability ^ 
dpmaiii and more receitt^ by Epstein (1979, 1980) in the personality 
aomain. It is noteworthy Qtat Sis<a»el (1979), an actaowledged ' •„ 
aia^ion of situatiohal specifity, recognized the need to operate 
• at different levels of g^erility for different purposes and to 
aggr^ate_ across the appropfiette level of heterogeneity. = 

While Tables 5 and 6- were concerned with the responses t6 
individual items. Table 7 deals with the characteristics of the 
total scoris on the two inventories, and with the relation between 
them, on the Test Opinion Inventory, total scores were computed 
wiai all item re^nses kdjusted so that high scores^ represent- a 
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TaSie 7 _ 

Ana iy s i a o ^9^? i S co re s on __" 

Teat Opinion Inventory and Test Usage Inventory 









/ 






Instrument 




Total 


Score 


Correlation between 






Analysis 


Total 


Scores 


! ■ ■ 
" • , ' ■ / • 


M 

sb 


75.40 
15.20 


(r.i.i4 






I« Test Opinion Inventory 


Reaiger23-3.18 










. '11 


.73 










N 


179 




' 1^12 


- .24 


! 


M 


7.74 




df. 
P 


-■ 177 
<.01 




sp 


2.85 








2. Test Usage Inventory - 


Raiige 


0-15 










'22 


.60 












.195 









Note. The reiiaibility coefficients i^y^ and r^2^ measures of interlial 

consistency (coefficient Alpha) • 
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favorable attitude toyatrd tests. The mean score on this in- 
ventory ik 75.40. -rhis score falls virtually on. the 75 midpoint; 
WhiiSh would be obtained If all 15 items were given the middle 
rating of 5. in overall attitude toward testing, this group 
of teachers can clearly be described ai moderate. The range of 
individual icbres, however, is wide, esetinding from 23 to 118 
(out of a ^ssible ra»ge of 15 Jo 135) ^ The internal consistency 
of the invrat6ry, measured by coefficient Alpha, is .73. This 
coefficient iSdicatesa subs tamtial level of eSpirical behavioral 
consistency aorosi the varied items included in ffie inventory. 

On the Teat usage invehtoir.- tlie mean score is 7.74 out 
of a possible, maxirfflim of 15. The individjial scores ran^e from ^ . 
d to 15. Like the previously discussed ^alyais of" item responses, 
tS^se total scores suggest se?ious deficiencies in , the background 
inforiation required, for Uie tise and interpretation of test . 
scores. While s5me individuals were undoxibtedly well informed, 
there are all tbo many ;in the group v^o were not* With regard 
to inteiSial consistexwy, the Alpha of .60 again indicates 

p // _ _ _ _ _ __ 1 

sufficient behavioral^cpSiistency for . the total scor^e to repre- 
sent a ihekriingfui construct . ^ 

Table/^ also giver; the correlation between total scores 
bp theXtwb inventoriei . Thii - correlatibft is -. 24 , -significant at 
the-^Ol level. Although hbt high, it indicates a clear tendency 



-37- 

. _ ; ■ ' _ - - - _ _ ... . . . 

fd:^^ those teachers who are better informed about tests to 

haye more favorable attitudes toward the use of tests in educa- 

• tibh. This finding supports bur hypothesis that adverse atti- 

J ___ _ _ _ _ • _ _ ■ _ a 

tildes toward testing result in part from miscbhceptibns abdut 

teat fanctiona and misinterpretation of test scores. 

Comparative AnaJ.vs±3-43£- Regpoh seg—o£ Black Teadfaers' 

in the total teacher sample, the representation of ethnic 
or cultural minbritiea other theui blacks was tod small for 
meaningful analyaia. ifhe entire group includes only three 
Hispanica^. 1 East Indiein, one Filipino^ cuid no American Indiana 
or bri^taia; WiS^ 27 black teabhers# the minority sample is in 
effect a black sample* Tlius it was decided to compare the 27 
blacks with the total -sample. Comparing the black subaample 
with the total sample, rather than- with the -white subaample, 
will of cotxrse have a blurring effect, tending to minimize 
differences. Hence we shall err in the direction of interpretive 
cautidn. We wish to avoid fdcuaing attention on small differences 
even \^en statistically significant. It is dtir object to aa- 
certain miarely the extent to which cbhclusioha drawn from the 
total sample may apply tb the black subsaxdple. 

ParticiTaaht Characteristics . A dbroparisbn bf Tables 1 and 
8 reveals certain demographic differences between, total sample 
and black subsample. Th^ proportion of males was substsmtially 
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Tablets 

Black Teisichers: Demographic Data 
(N=27)^ 



Variable 

Sex 
Age 

Education 



Testing 
Training^ 



Reported 
job title 



percentages 



Female 57.7 



20-29 
30-39 
40-49 

High school & fur«ier 

Bachelor degree 

Bachelor Si Graduate 

Graduate course 
Undergrad . course 
in-service 



30.8 
30.8 
,30.8 

11.1 
3.7 

25^9 

40.0 
8.0 
12.0 



Grad & Utidergr.S: in-serv. 12.0 



Classroom teacher 
Special educ . teacher 



74.1 
14.8 



Male 42.3. 

50-59 7.7 
60 & up 0. 



Master degree 
Master & further ^ 
Doctoral degr^ie- 

Grad & in-service 
UndergriS I^-service 
No formal training 



Specialty teacher 
(e.g. reading, 
math. ) 
principal 



22.2? 
37.0 
Q- 

4.0 
8.0 
16.0 



7.4 



3.7 



For item responses # N=25-27. 
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larger among the black teachers* 42% being men as contrasted 
to only 1996 among all ^the teachers, .^e distributions were 
roughly similar; wi€h the large^^majorit^ falling between 20 and 
49. The black teadiers, ixowever, tended^^o^ concentre 
heavily in this age range « with very few ovex:^0 and none over 
.60. ' . , ^ • 

Education shows a somewhat smaller percentage of black • 
tea^ier^ Wi^" It college degree and a somewhat larger percentage 
wiQi high school plus additional Special training. At the 
graduate levels however/ the proportions are virtually the same. 
Training in educational or psychological testing showed few 
differences, ft! though i6% of the blacks as compared to 1096 of 
the total sample reported no formal training in this area^ the ■ 
proportion reporting a combinatibn of undergraduate, graduate > 
and in-service training was twice as large among the blacks. 
Inservice training biily was also more commonly reported by the 
black teadhets. The distribution of self-reported job titles 
a&bng the black teachers is quite similar to that of the total 
group. The large majority were functioning as classroom teachers, 
a sizeable group as special education teachers, and a smattering 
on other sdhdol jobs. Thus^apart fran the giSeater proportion of 
-maie~teachers--ahd -the- somewhat :^:ycttmgert::^a^ 
^aracteristics of tiie black sample should not lead to substsmtial 
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Variable 



Table 9 

Black Teachers: Student Contacts 



Response Suinmary 



Direct contact 
Grade levels 
Nuniber of students 
Mdn N in ethnic groups 



Yea . 100^ . * 
Kindergarten to 12 
Mdn 14.75 Rtoge 0-250 



No 



Wh^te 0.9 
Hispamic 0.6 
briexit^i 0 . 



Bladk_ 11.3 
Axner. Indian 0. 
Other 0. 



0% 



■18 



ERIC 



■ -41-^ 

differences in bur findings. 

The data oh student contacts, however, sugrgest some rele- 
vant differences (Tablei 2 and 9). The entire black group 
reported direct contact with students. "Hie grade range, k 
to 12, was virtually the Scuae as for the total group. T!he 
medieui nuniber of students was smaller for the black teachers, . 
a difference that may be related to the greater concentration 
of black teachers in one br two schbbls that emphasize individual 
lized ihstructioh. ISie xnbst conspicuous difference^ however^ 
pertains to tiie etimic distribution of tiieir own students. 
1?he median nuHd^ers of white and black students in the total 
sample were 23 and 2, respectively; among the black teachers, 
tile medians were just under 1 white student and 11 black students 
Among individual black teachers, 10 reported having no white 
students, and an additional 6 reported having only one. Only 
three black teachers reported contacts with large numbers of 

» 

white students. In cbntrast^ only two black teachers reported 
having no black students^ and the large inajbrity had 10 or more. 

It would thus seem that the responses of our black stibsample 

^ '_ ■.. 

may reflect not only the etiinic identity of tiie respordents 

but also — and probably more significatntiy — tiieir teaching 

experience wi-Si predominantly black students. 

Findings Re cyarding Teal: Table 10 gives the percentage 

of black teachers reporting each test activity; these results 



_ _ TZibleAO^ • 

Percentage of Black Teachers Reporting Each Test Activity 



Activity 



Authorize testing program 
Select, tests 

Coordinate, manage program 
Decide to con ti|iue program 
Orient student to tests 

Adbninister tests 

Rccoive tost. scores 
Have acces^ to scores 
Use scores: understand students 
DS3 scores s instruction _ 
tiae scbriass grouping students 
Use scores s evaluate porformahce 
asa scores: identify special needs 
Counsel students re scoria 
Explain scores: parents or others 
a^her uses 



"Regularly . Occasionally Hever 



_ Mental Abil,ity- Tests 
Regularly Occaisionally 



Never 



is. 4 


26.9 


57.7 


0.0 . 


19.2 


00.8 


.e;.o 


ie.b 


64.0 


3.8 


11. S 


64.6 


11. a 


26.9 


61.5 


15.4 


7.7 


76.9 


12^5 


6.3 


79.2 


3.7 


11.1 


85.2 


34.6 


34.6 


30. @ 


11.5 


26.9 


61.5 


46^2 


50.0 


3,6 


22.2 


22.2 


55.6 


45.8 


29^2 


25.0 


34.6 


19.2 


46. '2 


70.4 




16.5 


30.8 


, 26.9 


42.3 


55.6 


37.0 


7.4 


16.5 


40.7 


40.2 


59.3 


33.3 


7.4 


25.9 


33.3 


40.7 


37.0 


51.9 . 


11.1 


16. 5 


37.0 


44.4 


37.0 


44.4 


16.5 


14.6 


40.7 


44.4 


40.7 


4g.l 


11. 1 


22.2 


' 37.0 


40.7 


23.1 


42.3 


34.6 


19.2 


26.9 


53.6 


16.0 
13'. 0 


40.0 


44.0 


16.0 


28.0 


56.0 


21.7 


65.2 


5.0 


' 20.0 


75.0 



I 
I 



N«23-27 



H«20*2<7 
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may be compared with those in Table 3/ which gives the 

corresponding data for the total group. Only a few clear trends 

' - ■ ■ - .. 

emerge from this comparisbn. With only minor exceptions, the 
percentage of black teachers regularly performing each activity 
is -larger for : achievement than for ^ility tests^ as was found ^ 
in the total sample. A somewhat larger percentage of black 
teachers report counseling or instructing students regarding 
tiieir test scores, and this difference from the total Vsample 
is more pronounced for ability than for achievement teats. 
Using tests in planning auid adapting instruction rans higher 
in relative frequency among %lack teachers than ' it does in the 
total saxnple> and this difference holds for ability^ as/ well as 



for achievemiaht: tests* / 

■ ■ ■ ■ . ■ ■■ ./ 

The ratin^^s of the usefulness of standardized tests by 

• \ _ V-_ 

black teachers coincide closely with those obtained in the 

total sample (Tables 4 and 11). Again, the mean rating is more 

favorable for achievement than^ for ability teats, although the 

difference is: not large. And again, individual differences are 

wide, the full scale range (1-9) having been used despite the 

small sample of participants. 

Turning to the Test Opinion Inventory (Tables 5 arid 12), we 

find t^at the black teachers tend to express somewhat more adverse 

opiHiohVldJbut tests ^^^tt does the total group. This difference 

appears both in the ratings of individual items' and in the total 



. \ 

••I I 

0 



Table 11 

Black Teacher Ratings o£ Usefulness of Standardized 
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SGores oii t^e inventory. Reference to Tables 7 and 12 shows 



! a difference of 8.24 in total score, significant at the .01 
level. /The black group also tends to give more extreme ratings, 
bespite the small number of cases (and the resulting magnitude 
of standard errors), nine of tiie ISjmean ratings deviate 
significantly from the theoretical neutral value of 5. Tv/o 
items yield significant deviations in the favorable direction, 
both <Jt the .01 level. One of these indicates s^ong rejection 
of an adverse statement (Item 2, testing is ah insult to hvunaui 
dignity)? the other indicates strong agreement with a favdrsUDle- 
statement (Xt^ 15, proper use of tests prevents unfair discrim- 

^ ination) . ^ These two statements were among- the fotir yielding 

significanti devxations -in t^e favorable direction within ^e 
total group. „ " 

•Five items show significant deviations in the lanfavorable 

" direction at the .01 level (Items 4, 5/6* 11^ 13) and, tWb at the * 

• (35 level (Ite:^s 3 and 14). The moat extreme ratings represent 
strong rejection of a favorable statement (±t^ 5> "XQ" te^ts 
are helpful in instructional decisions) and strong agreement, 
wi-ai an adverse statement (Item 6, tests tend to xinderpredict, 
s^ool a^iavement of minori^ children). Insofar as school per- 
sonnel may misinterpret low ability test scores as an indication 
of "underlydtng capacity for mental functioning, " these attitudes. 



on the part of teachers ^working with predominantly black groups- 
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Table 12 . ^ 
, . Black Teacher Responsea to Test Opinion Inventory 





- - 

item No.^ 


. * 

t 

Key Topic 


Mean^ 


SD 


Range 


f — 


V 


> 






* i\' 


Miiiitv teflta heio infltructioh. 


1 

4.28 


2.34 ■ 


1-9 




Teatino and htiman diqnitv. ^ ■ . 


. 3.36 


.2;23 


1-9 ■ 




Tntervieva vs. teats in colleqe admission* 


6.00 


2.33 


1-3 




TfiBtina is too widesDread In our society. 


'6.68 


2.15 


3-9 , 




"TO tefltfi and inatmctional decisionSi 


123 " 


2.12 ' 




g 


' Teats underoredict minoritv school achievement. 


7.23 


2.50 


' 1-9 . 


T 


Readina tests aid teachers i i 


5.64 


2.36 


1-^ 


* 9 


tests ineaaure rote Moryt 


5.52 


2.20 


1-9 


Test' scores independent of appearance. 


5.46 


2.37 


1-9 


* 10" 


Tests> cultural handicapSjand reniediation. 


4,00 


2.71 


1-9 


u 


. Mental ability tests unfair to minorities. . 


6.52 


2.57 


.12 


Eliminate :;all standardized^ teits in educate 


4.76 


■ 2.15 


2-9 <f 


• 13 


Nadonal norms encourage competition, ■ J ' ' 


6.42 


2.21 


2-9 


14 


Measuring only a few. traits is harmful. 


6.12 


2.22 


' 2-9 


*; 15 :: : 


Proper. ^est , use prevents unfair discrimination. 


6.73 


2.18 


2-9 



Total Score M = 67i76 (f - 2.40' SD = 10.46 , ■ , Range = 49-94 



Note. Scale 1-9; low scores indicate favorable attitude, except on: starred items. 
For item responses, N=25-27. 



of schoolchildren are understandable. Other examples of strongly 
endorsedV test criticisms are found in Item 4 (testing is too . 
widespread in our society) # 11 (mental ability tests discriminate 
against minority -children) , and 13 (national norms •encourage \ 
competition).. It is evident that all these instances of clearly 
unfavorable attitudes oh the plart of the black group have special 
^plications for the educational problems encoxihtered by^ minority 
children w Apart from the greater prominence of such items ^ the 
response pattern of the black teachers is similar to that of 
tiie iotai group w In general, it indicates a thoughtful aind. 
meeoxingful response pattern* While individuals can be characterized 
in tisrma of an overall level of favbra£le-un£avbrable attitude 
toward testing, tJie mSpsifestations . of this, attitude are adjusted 
to 'this particulars of specific situations. 

Oh the Test Usage inventory, the black teachers revealed 
less familiarity with relevant test knowledge thsm did the total 
group (Tables 6 and 13). Their mean number of correct responses 
out of 15 , was 5.S2, as compared to 7.74 for the total group, 
a different that is significant at the .01 levels The range of • 
scores ^ctended from 0 to 10 in ^is group, and from 0 to 15 
in the total group. 

Analysis of individual item responses also indicates weaker 
knowledge of specific test concepts and of releveuit backgrotmd 
material on the part of the black group. Thus there were several 



. Tablp _i3 

Black Taacher Pamiiiirity with Tost Concepta and Intorpr^tations 



Central Idea 



1 trrov of moasurement iand icore bands. 

2 Need Cor nbrais in ihterproting nuraorical scores 

3 Nature of criterloh-refdrehqed tests. 

4 Meaning of grade-^equivalent scores. 

5 Moaning of age. norms. 

6 Need for supplementary irifdrmation. 

7 Nature of reading readiness tests. 

8 Probability of individual exceeding median of 

overlapping distribution. 

9 * HOW hdrms are established. 

10 Environmental handicaps and tost scores, 
tt Meaning of. standard scores.. 

12 Iwhat mental ability tests measure 

13 Meaning of percentile scores 

14 Meaning of test reliability. 

f 

15 'Inter pretation o f grado^oquivalen t score. 



porcentaqe Choosing Each Response Qpfejron 
a b • c d e 




H - 5.52 



SD - 2.9S 



Ranqe « 0-10 



Note. Correct responses are boxed . , ^ 
Response Option e - Don't know —also includes 



1 respondj^t who marked 2 options for item 1. 
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items' in which the percentage of respondents choosing a wrong 
option was larger than the percentage choosiiig the correct 
option (Items ,1, 11, 12, 13). Two of these items (11 and 12) 
were tiie only two in which a siiailar reversal occurred in the 
total sample* .In the standard sc6:^e item (11) > the choices of 
the black teachers reveal a typical chance distribution across 
the three wrong options/ with a smaller percentage choosing the 
correct option, in. tile item ^pertaining to what mental ability 
tests measure (12)> the largest percentage b|>ted for "\irider lying 
capacity^" thus demonstrating the saxae misconception found in 
the total group, fts in the total groups also, the largest number 
"Don't Know" responses vrets given for item 8 (probability of ' 
individual ^ce^ding median of overlapping distribution) • \ ' ■ 
Similarly, tite largest nva^er of correct dhoices occurred on 
item 15 (grade-equivalent scores). . The only other items with 
more than 50% correct responses are items 2/ 5, and 6. 

Part II: Testing Coordinators 

Procedure . 

Development of Interview Form . In this part of the study, 
our principal object was to explore how decisions about school 
testing programs are made and how tests are selected. For this 
purpose, we prepared a basic interview schedule which was re- 
viewed ny project cbnsul^^rtjs specializing in educational 
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psychblogy* teacher training, and educationai administration 
"at the Fbrdhain Uriiverjeltx Graduate School of Education. 
y"' The procedure was aJ. > protested informally on a few persons 

knowledgeable about testxng in the schools of this geographic 
area. 

The intervievar followed a -semi-structured format, with 

liniform key questions to introcSuce relevant topics and probing 

questions for clarification and elaboration. A copy of the 

interview form is reproduced- in Appendix; C. Major topics 

discussed with the respbtidisints include: 

(1) Their relative autonomy in decision making 

{2) ^eir budgetary limitations, and how this affects 
* their progrsim ^ - _ 

(3) Their dependence on year-to-year authorizations and 
appropriations _ 

(4) gSie educational decisions for v^ich the test sccrea are 
being used 

(5) The rationale b^ind the testing program _ ^ 

(6) The information used in making various tefsting _ 
decisions , and %^ere such /inforaatioh is obtained „ _ 

(7) How respondents 'evaluate the adequacy of their tests 

(8) iSHe frequency with which they have changed tests 
in "the past ^_ _____ 

(^). How they have 5^ttempted to improve teachers' use of 

. » 'test scores - . . 

(10) The adequacy of _ infodcm test 
ptiblishers (including what they would like to re- 
ceive which is how unavailable to them) ^ 

(11) The availability and nature of a continuing education 
program for tTt'i teachers in regard to test use 

Data-Gather Procedures . Interviews were held with 15 

testing coordinators, drawi from different municipalities or 



districts in the tristate metropblitah New York area. The 
names of the coordinators were obtained from personal contacts 
of the project staff as well as from some of the testing 
cdordimtbrs themselves. In all cases, a member of the pro- 
ject staff contacted the potential interviewee on .tihe tele-- 
phone, explained the nature of the project and the interview, 
eihd set up ah. appointment for the interview. A senior member 
of the, project- staff then traveled to the coordinator's office 
so that -^e interview could be conducted in situ. After the 

Ja^ — : 

pfeestadblished topics had been covered, the respondents had 
the opportunity to continue tiie discussion in amy way they 
wished and mamy of them did so. The interviews varied in 
duration from 45 mihutei to 1% hours, averaging about V% hours. 
We considered the use of a tape recorder, but decided 
ij:^fj:er bur preliminary explorations because of the 
adverse effect such a procedure would have-on cooperation and 
rapport. Some schools had had experiences with newspaper re- 



porters who obtained test data through devious means and 

_ _ . _ ■ __ __ ^_ _ / . _ 

publicized tiieir findings, with unfor:Sunate after-effects. The 
result was a heightened sensitivity about any discussion of 
testing, whicA we found to be qui^ general among our participants 
■ Participant Cha ra cteristics 
. In no case was the participzunt ' s official title actually 
that of ."Testing Coordinator". Examples of their specific 
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job titles include; Dirict5r o£ Research and Testing. . Assis- 
tant to the superintendent for Testing and Evaluation. Director., 
of pupil Assessment and Records. Coordinator of District 
Testing. Research Associate. Director for Child Placement, 
and Oiild Study Team Coordinator. In ail L5 cases, thia 
testing coordinators had at least a Master's degree and five 
had doctorates. All were white; eight were Sale and seven 
fiamale. 

Perhaps the most conspicuous differences among the- 
participants pertain to tieir prior joh experience and specialized 
trainihg. and to the routes r^eie^ they reached their present 
positions. Six had been classrooi teachers as well as princi- 
pals prior to takirig this position fivi 5f these s.ix in 
the same disiiict in which they were currently working. The 
sixtii had bepn aie principal of a school that closed because 
of shrinking enroliSent> and had subsequently begun working 
at a neighboring, district as testing coordinator. Two of the 
other former principals had moved into this job wittiin their 
own districts for tiie aaie Reason. Three of the testing 
coordinators had been classrooS teachers wlio applied for their 
position ^en it was "pdsted"; all three explained the rationale 
behind their movement in terms of increased salary and freedom. 
Another set of tiiree coordinators had been special education. 



teachers prior to as stutiing their coordinator positions. Two 
o£ these said that they had become so extensively involved 
in federal*- and state-mandated testing and so Icnowledgeable 
about such programs that their districts had asked them to 
assume their current positions.. The third "special educator" 
wa.a simply desirous of moving into educational administration. 
One test administrator had worked in the schools, first as 
a teacber, later as a guidauice cdunseldr, and then as an 
admihistratdr related to guideuice, before finally assuming her 
role as test coordina±or^ 

Two of tiie testing .coordinators had been trained specifically 
for their positions through graduate work in educational psy- 
chology, one with a doctoral degree and one with a master's " 
degree. Neither had worked; previously for 'a state department 
of education. As^^ill be discussed later^ these two cbordina— 
tors were, clearly the best informed with respect to testing # 
recent developments in the field> and statistical consideratidns . 
But -^ey were probably least able td share this knowledge with 
other school personnel^ because their communication networks were 
relatively tsndeveloped. One of ^ese respondents^ for example> 
remarked ^at she was not sure she had ever talked with a teaser 
in the district about testing! . She talked only with administra- 
tors, ^o, in turn, talked with teachers. 



.. with regard to current responsibilities, three coordina- 
tors stated that they were in charge of all testing in the 
district. Ten coo;cdinators were in charge of all standardized group 
testing.- but not individual testing. In seven of these 
ten cases, their immediate superior was in charge of the school 
psychologists. In the remaining three, tiie functions of the 
school psychologisti: -were coordinated through another office, 
finally* two participants; reported that they influenced decisions 
ieiatihg to standardized testing, but could not "control" tiiese 
decisions. On tiie other hand, these two persona also had 
responsibilities in relation to individual testing and the placement 
of specif ia ^ildren within their respective districts . 

It is a^arint that our 15 testing coordihatdrs eadiibit 
considerable diversity both in their background 6 f experience 
in the school system and in the nature and extent of responsi- 
bilities in their current ^sitions. In these regards, they 
seem to be quite !:ypicai of testing coordinators in the country 
at larger 

Interview Findihga 

OvifView of ^e f est. in-: Proc-ra^is . A listing of particular \ 
.tests used at different r. rad- levels in the districts covered 
•by our respondents would b' :::^wieldy and would jeopardize con^ ^ 
fidentiality. More ^portanc from our standpoint ^waa the coor- 




Table i4 

Reported Rationales Underlying Test Uses 



Rationale / 


Frequency of 
Response 


^ Prpgraitaiiatii^ 

■ funded programs 
/ ^ TO fulfill state mandate. 

To demonstrate xritadiness to advance to the 
the next grade ' ' 


14 

7 , 

2 ■■■ 


To "flag" poor teachers 'and help principals 

To evaluate, curricula 

. To assign incoming., children to levels 


2 

2 
2 


Total 


29 


Reasons Specifically Related to Special Populations 
To diaghbse a child's weaknesses v for remediation 
To write a child' s Individualized Educational 

Program (lEP) - 
To decide whether, to have child tested by the school 

psychologist, or consider placement 
To identify the gifted 

To justify keeping children in specialized classes 


1 
A 

2 

2 

i 


Total « 


3.6 


, ; 

General Educational Reasons 

To help t^tiChers ..5;<5o their pupils grow 

TO provide information for: the yearly parent- teacher 

confexenca ... . . — 
^ Tots! 


4 

- 2 
7 



o 
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dihatdr'3 rationale as to why various tests were being given. 
The responses to this question are summarized in Table 14. 
inspection of this table demonstrates that the most frequent 
use of itandardized tests is to fulfill federal and state 
guidelines. Of the total 52 respondent comments on this topic. 
il relate to federal and state mandates. This nuniber includes 
21 of the 29 programmatic reasons an* all 16 of the reasons 
specif icaily riiating to special populations. Only infrequently 
were/^OTOen<ts mads relating to the peda^ogifaal betterment of 



/ A - 



/'the sc^JO'ols. , ' 

^'• ^Abilitv Grouping in th4 Districts. Of the -cta, 
:i2 grouped children according to ability lev«lfe rce aid' 

not. One of the latter,, however, does grbup -inx; . witJiin 
classes, of the 12 that grouped children, 11 used taat scoret, 
as can be seen in Table 15. OiE these 11, four used test scores 
"almost entirely," four "to some extent," and three "only to 
a minor eactent." In three of. the four dist^ricts in which teits 
were iased "almost entirely" in grouping children, it was never- 
theless reported that teacher judgments wei^ considered at 
least ats collateral information. \ 

• Teachers ' Ose of Teat Scores , in 11 of ^the 15 districts, 
the teachers received their students' teit .scores directly.; It 
should be noted, 'however, that two of the/coordinators remarked 



s 
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/ Te^Dle 15 

Sotxrces df Infdrmatibn Used in Grouping diildren 



• I • . - ' ■■ 

Source 


[ '— 

Frequency of 
Response 


Test Scores 




11 


Teacher judgements 




11 

4 


Parental input 




Grades' 




3 


principal ■ s judg^^eht 




1 


Agea-. ' _ 


o 


1 


Beliavior • prolDlema^ 




1 









7 



Ndte > Based on 12 schools that group children i 

^ xaae comments were made in regaid to a "special school." 

9 . ^' 



that teachers received the scores too late to be of se4vicei. 

ef the remaining four districts, thrii permitted teacdiers access 

to file scores , which had been placed in &e studehts ' miea, 

and one district blocked t&achers from access" to their students' 

I, ' 

scores. 

Twelve of the cbordinatora replied that their teichers were 
capable of. using test scores effectively, while three felt 
teachers were not able to do so. In addition, 30 replies were 
received to the question, "In v^at ways do. you think your 
teachers use test scores?" Thiie are found in yable 16. It 
It can be s^m.that the most co^bn uses, in order of frequency, 
were adapting instructiisn/ aiding individualizatipn, year-to- 
year compirisbn of child's performance, and wxi ting individualized 
Educational Programs ( lEPs ) . - 

Only one coordinator cdnmiehted directly as to why teadhers 

- , ^ - - - ^ - ---- 

did not use test scores. His eacplanation was . that teachers ' 

nobs are simply tod complex alriidy, and that teachers are flooded 

with ^:o much in for nation that -aiey are not able, to spend the 

time necessary to employ Uie scores effectively. ■ 

We asked a series of questions relating to tiie coordinator's 

_ . _ :\ _i« : _ ■ . 

impressions of teadhers ' orientations and attitudes about test 

scores. First, the coordinators v^rere asked whether their teachers^ 

^felt that test scores were changpable or modifiable, as opposed 



Table 16 • _ 
Teachers' Uses b£ Test Scbfrei 



y 


"" : ' ^ ' 


Reported Uses' 


Frequency p£ : ^ 




Response 


" ■ v _ 





Adapting iiiistractioil -8 
Aiding individaaiization : 6 



' Comparing a child' year-to-year 5 

Writing ^ lEES;. I . V 4 
Grouping chilaren (within classes) , 1 

: ■ • ' / ■ . 

Teachers, do not use test scores ^ 

r- - _ - .._ - - • - 

Teachers USB' teat scores ipnly _i£ and 2 

how their principal tells them to 



? 



to being fixed or pe^iSeht. Of the 15, 12 responsed that 
teasers did feel the scorei were chahge^le. Among' these 
12 poiitive respondents, seven offered additional specific 
.'cdrattents. Pour said that radical changes in test score were 
seen frequently —mostly among special-education children who 
had received iaiediition Two commented- tiiat they would like " 
^ compute chai^ge scbres to accentuate the amount of change 
Sie teachers Would see, b^t jSat the teachers ' unions had pre- 
vented the coordinatorjs from d5ing this., A final respondent 
expiainid that teachers were more aware of change in achievement 
scores than in mental ability scores. 

coordinators were also asked Whether they felt «ie so-called 
Rosenthal Cor Pygmalion) effect was valid. Pour responded, "Yes,' 
aid .eight siid> "So. " Three weare liiaware of this effect and, 
alttiough'two of them seemed quite interested in it, all three 
refused to comment without further information. 

We also questioned the coordinators as to whether teachers 
iSterpreted test scores, it least in, part, from a genetic per- 
spective. Six of. the 15 replies were affirmative and nine were 
negiti^e. Among the six affirmative Respondents, three added 
that.adiinistrators perpetuated this approlch because ■ 
"explained iw^» why some preddminantly minority schools con- 
" aistently' performed. poorly on tests. Two additional responses 
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stated that teachers' unions and teachers individually pei^e- 
tuated this concept for the same reason. ^TJie final affirihative 
response was coupled with the explanation that'^teachers saw 
children from the same families scoring sxmi-larly oh^ stahdar- 
dized 'tests, in tiiis instance, the test cbbrdinatbr^ a former 
teacher, did. riot seem cognizant of the fact that these siblings 
would have had similar family environments as well as common 
genes . ' 

Finally > the coordinators were asked to describe their 
impresaibns bf the teachers ' opinions about teating^ as- well as» 
those a£ a^iaistratbrs> psurents^ themselves (as testing 

cotDr^iriators) . Witii respect tb taachers^ five respbnc 
belieir«5^ that teachers wer® very negative about testing. An 
add5.tio2ial comment referred to teachers' fe<Biing that t^ere 
was just too much testing presently in the schools. Surprisingly, 
two independent comments were almost identical c two coordinators 
stated that two-thirds of the teachers were neutral and one- 
third were vocally antagonistic. Tliree other comments stated 
that teachers had reasonable, professional, well-^qiialified 
attitudes about testing, that is, teachers knew that testing 
was important and necessary and treated it accordihgly. J39iree 
final coiments related tb ^e cbbrdihatbrs ' impressibn that 
teachers "overused" test scores — - Shey relied too hectviiy bn 
test-score information and avoided using otiier informa.tion^to 
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get a ."total picture»of the child. One cbprdinator felt that 
he was hot able to answer the question. Thus, of the 14 coininents 
received, only, three could generally be considered positive in 
regard to the beneficial rase of tests by 'teachers. 

With respect to administrator attitudes about testing, ±2 
TOordinators offered opinions, while three replied that they 
"could- hot say." Seven stated that administrators were more 
knowledgeable and positive about, the value of testing than 
Were teachers. Two former principals supplemented their posi- 
tive connnents by Jtating that test-sbore information helped 
principals to spend ioney wisely. Four comments related, ttiat 
principals perceivedj tests as necessary evils. Another coordina- 
tor iaid (as she had said of the teabhers) that two-thirds Of 
adSinistrators were ngjitral and ohe-Siird antagonistic^ Thus, 
seven of the twelve responses, or just over one-half, were 
positive in regard to good testing use by administrators. 

With regard to the coordinators ' own attitudes, eight 
reported that they were more positive about tests than were 
teachers. The two who felt that teachers relied too"heavily oh 
test-score information considered themselves to be more bautious 
about the benefits of testing than were teachers. Five believed 
themselves to be about the same as teachers in this regard. In 
general, however, the intarviewer (vSio had also talked with 
'Inahy o"J: the -teachers surveyed in Part I of this study) observed 



that the coordinators tended to be much more positive about 
testing tiian are typical tea:chers. , 

Twelve of the coordinators tilought they were uncible to 
cbinment'on parents' attitudes- about testing. In most cases, 
they felt "out of touch," either because ,they rarely dealt 
with parents* or because they only dealt with the occasional ' 
irate parent .and, hence* could not generalize their perception 
' to parents as a whole. Of the three respondents who did comment 
two felt ^at parents lacked Qie knowledge to properly evaluate 
tests and their educational benefits. I3ie remaining comment 
was that parents liked stauidardized testing: scores helped 
them to see how their child was doing and permitted tiiem to 
hold the schools accountable for the child's growth and p^ar- 
£ ormance. 

Reiadrted Misused b# Teats ^ The coordinators were asked . 
whether they were aware of any misuses of test:? in their 

districts Even given the promised anonymity of the interviews, 

if ■ ' _j_ '_ ^ 

it %ras hot surprising tiiat six replied negatively, of the 

nine comments made, only one occurred more thaui once. Most 

of these "misuses" are not of the classics type leading to in- - 

correct diagnosis or placement of individuates. Two coordinators 

stated that the local press had "somehow" obtained . the test-scon 

means of the schools within the district arid had published them. 
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although these data were supposed to be confidential. The 
result was somewhat enflaarassing, insofar as schools differed 
markedly in mean scores. Another coordinator replied that, 
against her advice, there were genetic interpretations of test 
scores, bedauie this interpretation was needed to "explain 
away" differential school averages and differential school 
growth rates. Within anothir district, the coordinator explained 
that special education teachers received only the overall test 
scores, whereas subscores are necessary for proper remediation; ' 
he fait this was a misuse. One coordinator reported that a 
secretary at the district level had inadvertently destroyesd a 
number of scores, and that as a result olde^ sco^ei had to be used 
for administritiVo purposes. Another coordinator ali6 reported 
something which he deemed a serious misuse of test scores, and 
wliich would, if trui, iiiiingly contradict a considerable body of 
literature. This coordinator felt that cOiildren with high IQs 
generally receive less than biiir fair share of the teacher ' s 
attention. 

Another comment Was that, since teachers were evaluated • 
by Qxiir students' averages, there had bein^^a^ase of teachers 
helping itudents cheat and providing them3with answers iri advance 
Of the testing. In another qase, the cpordiia tor cited as a 
misuse 'the extreme duress Qiat students feel in taking testa. 

. ' . 

Finally, one coordinator reported that moat standardized tests- 
seemed to have v6dabularY levels whidh were too high for- his 



districts' schoolchildren. Thus, of the nine instances 
identified'by the coordinators as test misuses, two-thirds 
six related to the interpretation and use of test scores, where- 
as only two re3a ted to test-taking and one to the nature of the 
tests tJiemselves. ; /"^^^ 

The Job of the Goordinator , Three of; the coordinators said 
that they made most of the tasting-re3a ted decisions autono- 
mously. Eight made decisions in conjvinction with various ad- 
ministrators and ojbhir persons. The ronaining four described 
themselves primarily as information providers. They felt that 
their role was to supply various individuals or groups with 
relevant information and then letting them make the decisions. 
The types of persons ijivolved. with .the test coordinators in 
making testing-related decisions are given in Table. 17. 
Assistant superintendents and principals lead the list. Pour 
respondents reported Testing Councils, composed of central 
administrators,^ curriculum personnel, principals, teiachers, and 
parents. ' 

Testing coordinators were asked to describe how encumbered 
they were by financial considerations. Nine felt thai;, they did 
not need amy more money. Among these* one said that if he could 
test less and give back some money to the district, he would. 
One coordinator did report that he underspent his budget last 
year aind turned back money to the district, toother said that. 



Table 17 _ _ ^ 
Types of Persons or Groups, With Responsiiilities f 
Making Testing-Related Decisions 



participant Category 


Frequency, of 
Response 


Assistant Superintendents 
principals 


6 

5': 


b- - ■ 

Testing Councils 


.1- ■ 


Teachers 


2 


Parents 


2 


Ciirriculuih Peradnhel 


1 ■ 


S<diool Psychologists 


1 



* In addition to testing coordinators . 

^ Testing councils are composed of central administrators, 
personnel, principals, teachers, and parents. 



although financesa were adequate, "Every single penny was spent," 
The respondent from still another district reported that their 
budget was adequate only because they score their tests them- 
selves. 

Six coordinators felt that they heeded more money. Of 
t^ese# four needed it because they wanted teachers to dons tract 
more district-level, criterion-referenced tests. One of these 
also wanted to computerize the test administration process » 
but was fiii^cially tinabLiB to do so. Another coordinator 
wanted money to be able to provide teachers^ with test-use work- 
shops. The last coordinator said that she could only "make do" 
oh their budget by burying bills on other budget linds not 
related to , testing. • , 

Sources of T63t Xhf ormat inn . The test coordinators were 
asiced v^ere they went to get information about tests and testing 
Their responses are tabulated in T^le 18. By far the largest . 
source of information was materials provided by test pablishers 
and their representatives. The footnoted comment in this table 
is of interest: one coordinator stated that he had attempted 
using several hardcover texts and had found them all too dated 
to be of value. 

The test coordinators were then asked to evaluate the use- 
fulness '^d quality b£ information they received from test 
publishers. Their responses are found in Tible 19. Of tiie 



V Tatble 18 
Sources of information abJDtil: Tests 



Source 



Publisher Information 

^_ ^ ■ / ■ . - 

Consultants / ^/ 

■ ' ■ ■ ■ /' 

Buros MM5f / 

Conversations with j^rsons from 
otiier districts 

Back files 

NO tes^'from class materials 
State documents 



Frequency of 
: Response 



13 
3 
3 

•2 

2 
1 
1 



test coordinator stated tnat hardcover books were invariably 
out-of-date. 
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22 responses received, vast imai .)rity woxe exceedingly 

• negative. In general^ tJie imt zioti provide-d by publishers 

is seen as biased and not especially helpful^ that is, not 
directed at the (Questions the coo r^Vinators. feel require answers. 
Nonetheless, as stated above, the coordinators use information 
supplied by test publishers in making testing decisions as 

xUi'^xr . largest source— biased or not. 

f ■ 

The Goordim tors were asked TAihat^informatibn^ products # 
and services they would like to receive f roin publishers that 
they are not currently receiving. A total of 19 responses 
were received^- with very few repetitions or similar comments. 
Four cbbrdihators called for quickei: scoping services. In 
connection with computerized score reports^ two coordinators 
requested better individualized diagnostic printouts a^ ^ \ 

reaisonable prices, and ano^er two requested better test reports 
to send home to parents. Two coordinators . alko suggested the 
need for better math tests. The remaining responses can be 
grouped under requests for new services and new materials. With 
respect* to desired services, one test coordinator each asked 

for the quicker returning of 'pbone call £4q?iests for information, 

. - - . - . - ■ - - - - - - / - - v - _ 

in-service training related to the diagnosis- of leatrnihg dis- 

abiirties^ the identification of other local school distrdcta 

that are using /the same tests (this coordinator actually said that 
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Table 19 ^ , 

Responses of Cdordinatbrs Regarding Test Publisher information 



Statement 


. Frequency of 
Response 


_____ . __ " ^ . , ■ 
Is biased and dishonest 


9 


Does hot answer our needs or questions 


4 


Tries to invoke fear in us (to prevent 
us • from changing tests) 


: 
1 


is too oriented to smiles, not informative 
enough. 

• 


i 


is too hard to understand 


1 

; . 2 


Must be seen frpm piajlishers' perspective 


i ■ 

1 


Depends on the sales representative; some are 
good and seine are poor 


1 . 1 

i 


IS quite useful 
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two pxiblishers had told him that they had policies against 
pro^^i^ing these identities) , arid honest information. With 
rjes^ect to new materials^ ah additional four cbmrnerits were 
made, three of ^ich concerned grade- level problems. One 
coordinator each requested a listing of items oh a test by grade 
level, readability es'tii^ates of tests, and test items ^ and the , 
packaging of various testing ^teriais by grade level. The 
final cosnnent suggested i^at more tests be cbhatructed using 
a jbask analysis of the measured construct^. ' 

The cdordinators were- next asked how^ they felt tests them- 
selves should be changed. On the wljole, their responses — 
even wi-th follow-up questioning - lacked specificity. Pour 
coordinators^ however, .; called fb^' more district-level teats 
whidh are closely tied to the curriculum. ' Three coordinators 
each called for bitter reading tests, tests for the bilingual, 
and achievement .teats t^at were more behaviorally based and 
diagnoiatic. Of the remaining comments, two called for improved 
testincj for special populations (one for the handicapped and 
one for the learning disabled), and one each called for the :> 
Rasch model testing of more skills, the forced external scoring 
of tests (e.g., outside the district), increased use of task 
cuialysis, and redaction of duplication in various tests. 

The final set of questions related to the ^coordinators ' 
feelings about changes in testing ..that were likely to occur. 



Thirty^six reaponsia were made and these are presented in 

Table 20. By far the largest htaiiiber of conments predidted a 
Sovement away from national norms and toward district-level, 
curriculum-baaed tests. In decte^sing order of frequency, there 
was also mention of increased accountability through testing, 
and the use of'" equating to reduce duplication in testing.. 

conclusions, and RefXeetiona . sbme general conclusions 
can be drawn abouf distxic"t-level testi^^ even / 

on the basis of. our imall sample of ; fifteen . First, • the y 
coordinators are generally well-trained professionals, 
' although in' most caaii j they lure not in positions for which 
their specific, traiiiih^. .anci'' prior experience fitted them. Never- 
theless, they kre Tceyw&ei'aofis in the sense that thej^ Say have ^ 
acceaa via formal as ,4^11 as informal communication chains to , 
both high-level district personnel and ; teachers . ^^ey coor- 
' dinate, testing prc^grams which are, in general, adequately funded? 
these testing programs generally involve the evaluation of 
..govemmentallyy mandated educational activities..^ 

Ih general, the c5ordihators believe' that tisti can have 
beneficial value to tiii schools, even though teachers are 
relatively negative about tists. Principals, they seem to feel, 
h6ld the key to whether teacft^s consider tests as important 
and uie the scores,- for example, in planning or adapting in- 
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: Table 20 

^ Cbxnmentsf about t±ie Future d£ Testing in the Schools ^ \ 



Comments 



Frequency of 
Comment 



Movement av^y from national norma and toward district- 
' level, curriculum-boxmd teats 

Increased accountability through testing 

Use of equating to reduce dupLicatiion 

Better use of test information by teachers and specialists 
'Doing away with labels through the use of lEPs. 
More testing personnel in the kchbols 

Better teacher-tester cdmrouhicatibh ^ 
Better tests and diagnoses of learning disabilities 
Bette^^^^^^^^erized- test score reports for parents 
Less reliance on gs^ade eqt^ivalents 



13 

5 
3 
2 
2 
2 
1 
1 
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structidn. The coordinators would like to have the time auid 
money to provide workshops on proper test use, although only 
a minority of them (4) are currently able to hold such work- 
shops . ' ' ..^ 

The coordinators feial trapped.. Gbyeriimental mandates 
^insist that they employ certain types of tests. At the same 
time, they are xihable to obtain the information that they 
need about specific, tests: standard, impartial sources are too ^ 
dated, and current test ptiblisher information is too partial' 
and incompletes The source of ' information about whidh- several 
spoke most highly ^vraa the use^^of^e^ cbnsxTltants not 

connected with test gybifihers. Most districts, however, do 
idt apg^r^^^ haye tfie funds to employ these consultants as 
heeded. 

" ffie training of the testing cbordiiiatbf s is critical fbr 
Sie effectiveness with which they handle their positions. Those 

have emerged fr^ relatively scientific-psycho logical back- 
grounds are less likely to hold serious miscbhceptiohs about 
tests. But they tend to have limited conmninicatibn patterns wit 
the school saystem as a whole; rather, they tend to fu;ut^ 
^^information to decision -makers. On the othM^^nd, former 
principals generally have had consdLd^r^£le amount ' of prior 
" experience witih thia workin^^--bf the educational 3?^stem. And 
they are able to use this experience in achieving their goals.': 



it was these former principals, for. example, who were most 
likely to hold workshops for teachers, even t^cugh ttey had 
less positive attitudes and less knowledge about testing than 
did the more psycho logically trained testing cobrdihators. 
Similarly, th^ - were more likely to have the power to make 
decisions on their own. They were also more distrustful of . 
the test pulsixshers. improved information directed to these 
individuals, in the forrti of written materials, consultation, 
and workshops, would probably yield the greatest dividends for 
the improvement. of test use in ?:he schools. If t±iese workshops 
were 'conducted oh a regional basis by the test publishers, they 
would also probably imprcrva intrer-district cross-f ertiliza.tion 
and reduce the strong ^aLhti-*publisher sentiment. 

• Simiiariy, the comments about test publishers were so largely 
negative as to suggest the wisdom of reexamining current practices 
of test sales., it would, probably b<a fruitful to reduce the 
saliss emphasis and increase the educational function of the pub- 
lisher representatives. One might €iven consider paying these / 
representatives totally by, salary aiid avoid commissions; this 
might reduce the adverse public relations that result from 
hiqh"^p^essure, impersonal sales* For reasons of cohf idenriality , . 
test and ptiblisher names have been removed ffc3m the statements 
citid in this report, although they were mentioned frequently in 
tie actual interviews. 



There is 'potential for improving conmonicatioh with the 
test coordinators. must be remembered that these indivi- 

"duals f lei loyalty to their school districts rather than to 
the testing profession. Teit coordinators are, in fact, clearly 
ke3r personnel in that they hold considerable influence through- 
out the school system. A merging of their local interests with 
the goals of improved" teat use should be possible. 

PART III: PARENTS 

SevelOOTtea^^ and Pretesting of Parerrt Su^jgZ- Initially, 
the parent ihstrument ' was diveloped and pretested as a semi- 
st^ucttir^ interview. On tiie basis ci£ pretest data,- and be- 
cause of the availability of PTA g«>upi as participant :^ol,^.. 
it was decidid to ^plby small-group procedures with a written 
questionnaire, thus paralleling the procedures followed with 
teachers. 

Following prepifation of a preliminary inte:rview form and : 
initial revisions on the basis of consultant comments, pilot 
interviews were conducted- with' a total of 10 parents (8 females 
and 2 males), all of whom were enrolled in the. Fordham Univer- 
sity" Graduate school of Religion and Re'ligious Education, -rhe 
interviews were intensive and opeS-ended, rangfhg from 30. ^ 
minutes to two hours. Alttiough the group was small and selected. 
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espec2ially with regard to educational level, it served its 
purpose well at ttie initial stage of instrument development: 
many responses were obtained to the open-ended questions, and 
. a content analysis o£ these responses provided useful leads 
for the subsequent formulation of objective questionnaire items. - 
The prateist results also demonstrated that the questions elicited 
a diversity of attitudes, the responses of individual inter- 
viewees ranging widely for each item on a 9-poiht: so^J. > 
at least some items yielded a range from 1 to 9. ^e responses 
also reflected expected item differences, group means for 
individual items, varying fr^ 3.2 to 7.1. 

A preliminary group form of the Parent Survey was developed 
and pretested in dctober, 1979 w±th three new groups of parents 
drawn from^ie^Bafi^^qtirce used in pretesting the interview 
form. The final revision was prepared ou the basis of these 
pretest result j. A coje^ of this form is enclosed in Appendix D. 

The B'irent Survey consists of a cover page eliciting 
demographic .^ata about tiie respondents and their school-age 
children, a 27-itCTi questionnaire entitled Attitudes Regarding 
A^ievement and* Mental ^Jjiiity Tests, and the same Test Opinion 
Inventory given to teachcirs and described in Part I. The 
"Attitudes Regarding/^hievement. aucld Hental Ability Tests,'* 
consituting the major part of the Parent Survey, utilizes three 



t^es of iteis: ratings (on a nine-point scale) of dr^grees of 
approval or disapproval of tests or specified nse- of tests, 
checklists for recording both factual and attitudinal responses, 
and a few open-ended items. The principal topics covered by the 
items include reactions to the- use Of tests in general as well 
as to specific uses, of tests, and reactions to one's own 
^iidren being tested. Fee^ack regarding children's test 
performance is explored with reference to whether or not it 
was received, whether the parent had to revest it, the form 
in which it was received, and how useful the parent found it. 
All questions are repeated in^arallel forms, one- dealing with - 
achievement tests and one'^With cental ability tests. 

Data^a^eril^ lisceduresi At an early stage . in the pro- 
ject, Qie decision was reached to call upon PTA groups as partici 
pants/3£' tixis part of onr research, if we are interested in 
^^ys to iiprbve the 'i^i f-f tests in the sdhools, we^ neai to ; 
begin witii the Soat ^xsaxsihg members of the consumer community, 
among parents, this means .PTA members, particularly those who 
attend meetings and take an active interest in educational 
problems. In this sense, our^^pa^^t samples are selected rather 
than random. It wouid^ .cei^ainly be wasteful to begin by trying 
t5 communicate with those: parents who may lack the time, the 
es^piriential background, or the motivation to try to improve 
educaitional conditions. 
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^ Acdordin^ly, we utilized the same referral^ sources through 
\^i^"we had obtained teacher groups^ namely the faculty and 
administration of the Pordham University Graduate School of 
Education and professxonai contacts available to project staff 
itiembers. Through -these channels # we were ibie to obtain data 
from 12 PTA groups— affiliated with 10 public schools, one 
parochial school, and diie private school — withdtn tie geo- 
graphical area described in the introductory sc ^on of this 
pro^ecti She identical confidentiality commitmerits were ob- 
served witii these PTA groups as with the teachers and testing 

^. l__ ' . : ■ ■ ■ . 

coordinators w 

Data gathering procedures followed closely the same steps 
described for teacher groups at every stage. A total of 223 
parents petrticipated, the nignber ihciuded in each session 
ranging from 8 to 28 . 

After the completion of data analysis, in October 1980, 
each PTA group received cm individually coinputeriized report 
of its own data, together with the overall project results on 
the Parent Survey and an invitation to contact the project staff 
if further discussion of the report was desired 1"" 
participant (^aracteristics - , 

Table 21 summarizes the demographic characteristics of 
the 223 parents who participated in ^is study. Although the 



Table 21 

parent Sample: Demographic Data 
(N=223)^ 



Variable 



Sex 
Age 

Ethnic 



caiildreh in^chdol 
Total Number* 
in Public SpKobls 
In parochial Schools 
In Other Private Schools 



Ages 



Response Summary 



Female 92.8% 



20-29 
30-39 
40-49 



Whi^e (non-Hispanic ) 
^^^aclc 
oriental 



MeEm^= 2i 17 
Mean»li8l. 
Meansbw23 
Mean=1.35 



3.2% 
66.2% 
27.9% 

94.1% 
3.4% 
0.9% 



Male 7.2% 

50-59 2.3% 
60 & up 0.5% 



Hispanic 0.9% 
Amer . Indian 0.9% 
Otitier 0 



SD = 



1.11 

sp=i.b€ 

SP=p.76 
SD*-*6.44 



Rahge=l-8 
Range 0-7 
Range 0-4 
Raonge 0-3 



Mean ■ 10.7 



SD = 5.7 



Rsuige a 4-18+ 



For item responses, 
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: ^ioui.: coni'tsted chiefly of females, 7% were males. Iri age, 
\\u grrap fell predominantly between 30 and 39, with slightly 
w;?«r 'Urth in ^-he.4d to 49 decade, and very small percentages 
ac yovTiger and older age iex^eis. All had children in school, 
the n.;VTO niahber heing slightly over 2 and th^ range from 1 
to 8. The largest number of children were at-tex^ding public 
schools^ with private and patrcichial schools following in that 
order. Thes children ranged in, age from 4 years to 18 y^ars, 
with a mean age of 11 years. y 
Total Group Results 

Rated ^sea-of Standardized Tests . In the first sectidn,^f 
the ParehCsUirvey, respondents recorded their^^^^inion o.f various 
uses of achievement arid ability tests oirnine-point rating 
scale5s> raungihg from strongly dis^prove through neutral to ^ 
strongly approve. The idimtipfiSl uses were rated for adiievement 
and mental ability test^s^lon successive scales- Tal:^le 22 gives 
the means and staiidard deviations for each rati:^: - The first 
pair of scales called for ah overall rating of the use of the 
two t^p^ of tests with schoolchildren. The next five pairs^^^ 
-ere' concerned with the use of tests in making specific. educa- 
tional decisions about individuals, including tracking^ giving 
extra instruction, influencing career plauis, and identifying 



/ 
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parent Ratings of Uses of Standardized Tests 



X ' __ _ ^ . 


Achievement 


Tests 


Menta 


Ll^^ilitY-Tests 


test Use Rated 


Mean^ 


SD 


Meam 




Overall use in schools 


6.04 


2.29 


5.45 


2.42 


Tracking decisions - 


5.37 


2.61 


4.80 


2.59 


Additionai instruction 


7.43 


1.89 


6.37 


2.34 


Influence bareer plans 


4.38 


.2.55 


4.07 


2-44 


Identify intellectually gifted 


5.61 


2.69 


5.41 


2.77 


Identify children wifii learning 
c disabilities 


^ 5 .49 


2.75 


5.25 


2.70 

1 



Note. Scale l-;9; obtained range 1-9 for each item. 

High scores indicate favorable attitude. 
For item responses, N = 219-223. 



= .13-. 19 



b (7* = .16^.19 
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inteiiectuaiiy gifted students arid chiidreii with learning 
disabilities V 

J / .J 

Xt should be /loted, £irst, that the . mean rarings are con- 

sistently higher for achievement than for ability tests. Although 

varying in amoimt, this a^L'fiarcnce holds across all uses. There 

is complete cbnsiistenc<^. liov/ever, in the rank order of these 

ratings for achievement '^ahd ability tests. In this regard, the 

t^'ipk, of decision to be made on the basis of tests seems to 

^-^r<*^jh more heavily Qiari does the type of test employed^ The 

highest ratijigs are assigned to the use cf tests as a basis 

for giving students added instruction.. The mean ratings for 

this use of testing, 7.43 for achievement "tests and 6.37 for 

aibility tests, deviate by large and statistically significant 

amounts from the theoretical neutral value of 5. 

- - -•- 

The overall rating* v^ich comes, next in reuik order, is 

also significantly favorable for both types of t^sts. The 
uses of tests for identifying gifted cuid learning di£s<>hled 
children, in that order, are also rated favorably. Trpcking 
decisions are rated only slightly above 5 with regard to achieve- 
ment tests, but fail -below 5 with regard to ability tests. 

______ ±^ _ / __ ___ __ "\ 

Career decisions based on either type of test tend tg be dis-- 

approved, both mesui ratings falling significantly below the 

neutral value at ' the .01 level. It is noteworthy that both 

tracking and career decisions have long-term implications. One 
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sehses here a stispiciousness about possible irreversible 
decisions and tie libeling of children on the basis of improperly 
interpreted test scores. 

Test gsea ^ Own ehiid'a gc^hool - Parents were next asked 
to consider the same five types of cest uses discussed, in the 
preceding section, this time with reference to current practice 
in their own child's school. Our object in this set of ques- 
t'ioni was to assess how much'parenti know about the way tests , 
are used in Qiexr children 'ii schools and how they perceive 
such uses. Table 23 reports the percentage of parents vftio 
reported ttiat tests were or were hot used for Saking decisions 
in the specified areas, as well as the percentage who stated 
they did not know. The same ^estions were asked with reference 
to achievement tests and mental ability tests. 

An ^aSination of Table 23 shows that, .as perceived by tiiis 
group of parenti, achievement cheats were used much more exten- 
sively than were ability tests for all types of decisions. . 
Despite the diversity of purposes listed, the percentages of 
respondents indicating that achievement tests ar^ employed for 
tracking, additional instruction, and the identification of 
gifted and learning disabled children are closely liSilar, ranging 
from SO to 67- influencing career plans stands out ^s the sole 
exception, with only 10%. The role that early test results may 



D.'3 



3 
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Table 23 

Percentage of Parents Reporting Test Uses in Own Child's School 









Cental 


ability Teats=^ 


Test Use 








Yes 


No 


Don • t Know 


Yes 


Mo_ 


ix>n ' t loi' 


Tracking decisions 


60.0 


10.7 


29.3 


32.3 


23-3- 


44.4 


Additional ins traction 


67.0 ' 


7.9 


25.1 


32.x 


20.2 


47 i 7 


Influence career plans 


10.3 


31.5 


58.2 


7.9 


33.2 


58.9 


identify gifted childrc^^n 


63.3 


.9.8 


27.0 


45 . 3 


18 . 9 


35.8 


Identify children vri'^i 
learning disabHj;.t.^*i2s 


61.9 


7.8 


30.3 


43.2 


16 .8 


40.0 


Ot^^r 


37.7 






27.4 







* N = 213-218 
N = 189-193 
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play in channeiing interiiti and steering individuali into 
differiSt educational programs is probably too subtle to be 
readily Apparent. • In fact, over half of the parents reported 
that: they did n5t know whether achievement or ability tests 
were used for Qiis purpose in their child's school. 

Turning -spedificiily to mental eitility testi, we find 
somewhat greater differentiation among the different test uses. 
Tb.v p,ore cSAsfcinctly "educational" decisions, such as tracking 
c ,i ..Se provision of extra instruction, are less often influenced 
by ^ility tests than are the more '-psychological" decisions 
that call fdr more causal analysis and understanding, such as the 
iienljification of gifted c^.ildren and of students with special; 
learning disabilities. 

" in two open-ended quest-i^na, parents were asked to list 
any other uses of achievement and ability tests that they be^ 
lieved were being made in their «=hila . school. The responses 
mentioned essentially the aaSe uses jor both types of tests. - 
several parents merely repeated usis already listed, often 
specifying more detail or providing^concrete illustrations: the 
most, common examples . referred to-4racking and the identification 
of spefsific disabi. ^Tere was some mention of accounta- 

bility, with referen^ V'^th teacher^ and spools. "iJhe most 
numerous set of ™ consents pertained to understanding and 
evaluating the^ild's performance- in t....ias of botii cognitive 
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and rloncognitive vari^ies. In this connection,, some question- 
iiie test uses were cited, such as labeling children and con- 
cluding that a child is lazy if he or she performs more poorly 
on achievement than on ability tests. ' The old stereotypes and 
misconceptions about these two categories of tests ares certainly 
found amphg'^ parents, as they are among teachers. And of course, 
the teachers may have comimmicated. such interpretations to the 
parents. 

G 

Finally, we may examine Uie percentage of "Don't Know" 
responses, i^art from the previously mentioned "career plans'' 

item, \«Sich yielded 58% and 59% such responses for achievement 

_ " _ _ _ _ " \j ...... - 

auid ability tests, respectively^ the proportion is consistently 

and substantially larger fof mental ability ' tests. The elimina- 
tion of group "intelligence" tests from several of the schools 
we surveyed may account part for this discrepancy. On the 
other hand, when mental ^ili^ tests are administered oh ah 
individual basis by professional examiners^ tiiere is more need to 
discuss the findings with titxe child's parents. Whatever the 
reason; tiie percentages of parents reporting that tiiey did not 
know \i^ether tests were used for the remaining four types of 
decisions ranged from 25 to 30 for achievement tests, and from 
35 to 48 for ability teats if Also relevant to these findings is 
the relatively large numiDer of nonrespohdents in this pbrtiph 
of the questionnaire, ranging from 5 to 10 for achievement tests 



and froS 3d to 34 for atoili^ tests. We can assume that 
„o.t Of these nonr^spondents also lacked lo^owledge ^out current 
testing practices in their child's school. On t^e whole the^ 
indications are that this group of concerned, active parerits, 

- ^ — 

attending PTA meetings, wai not as well informed about the 

use of te^t^ .in their children -4 schools as would he desirable. 

^eactic^^ £o last use wiav ^ ^ild. In exploring parents' 
reactions to the use of tests with their own children, we 
followed two appro^ci^es'. First, on a pair of nine-point rating 
scal^., parents indicated how Sey felt about their child being 
tested in school with achievement^ and mental ability tests, 
respectively, mean ratings, given in Tabli. 24 are 6.03 for 

achievement tests and 5.56 for abilir^r tests. Both indicate 
approval' beyond the indifference point of 5, the deviations 
being significant at ^e .01 lev.l in both case^r The approval 

is slightly stronger for achievement than for ability tests, 
but the difference just falls short of significance at the .05 

level. 

ftpproachihg the question from a second angle, we asked 
parents v^ether they ^uid prefer that their children receive 
more or les. testing in .chool. The replies are summarized in 
Table 24 for a^iev^nent and ability tests. The largest per- 
centages - 48.for aa^ievement and 35 for ability tests - re- 
'ported satisfaction with the present amount of testing. The 
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Tabie 24 

Parenl: Reactions to Use of Testa with Ovm C!hiid 





Question 


Response Smmasv — 


Achievement Tests 


Mental Ability Tests 


Approve o£ child being tested^ 

Perceatage preferring; 
More testing 
Less testing 
Present:' '^oun t 
hot ^ sure •> 


1*^6.03 SI^2.5b 
N^223 <^ .17 

6.4 
30.6 
48.4 
14.6 

(Sr=219) 


JP5.56 SD^2.65 . 
N=218 <35J=> .18 

9.0 
26.1 
35.2 
29.6 

{1S^199) 



* Scale = 1-9 -, - obtained range = 1-9 

High scores indicate approval 
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next largest percentages (31 26) wanted less testing; 

-and the smaiiis percentages (6 and 9). wanted more testiifg. A 
sizeable percentage indicated aiat tiiiy were not sure, this 
percentage being twice as large for ability as for achiev«nent 
tests (30 vs. 15). To this findi^xg may be added the presence 
of 24 nonrespondents for ability tests as compared to only 
4 for achievaaient tests i 

Immediately following Sie question in which parents Were 
to check that they preferred more or less testing, were satis- 

7 

fied with present amount, or not sure, «iey were asked. "Why 
do you feel this way?" Among tiie parents wanting more testing, 
the most frequint reason given for both adiievement a^d ability 
tests was that iuch^ testing provides feedback to parents and 
follow-up information. Additional Reasons listed for more 
achievement testing included that it increases the child's 
motivation, sharpens test-taking skills, and contributes to 
accouixteibility of teachers and schools. 

The principal reasons for preferring iiS testing of both 
types (in decreasing order of joint frequency) 'include the 
opinions tSat tests are: probably not accurate; generally not 
useful; too time'-consuming and/^_expensive; too emotionally 
. stressful; used in Saking unwarranted judgments and labeling 
children; 22^ used by teachers to follow-up on scores or make 
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Gomparisdns over. time? and culturally or radially biased. It 
should be noted that the last reason was listed by* only one 
resfKDndeht for achievement tests and only two for ability tests. 
One comment cbhtrilnated by six respondents wit^references J:6 
achievement tests only was that teacher judgment of class work 
provides a better estimate of student performance than do 
achievement tests i 

The parents ^o were satisfied with the p reaient amount of 
testing generally gave reasons that were similar to those cited 
in suK>ort of more .testing. Quite understandably, those who 
were not sure gave a combination of reasons l^at others had 
cited in support of more or less testing; For ®campie, they 
might say that testing is valuable but emotionally stressful, 
btiier respondents mentioned only an advauitage or only a dis- 
advantage of testing as the reason for their indecision. The 
one new cbnment' contributed by ah "unsure" but thoughtful 
parent vras that ability tests are useful for special children 
only. 

Feedback Regarding Test Results ^ Becauses of bur concern 
regarding conmninication, we were especially interested in the 
nature and extent of feedback ^ese parents received regarding 
the test performsuice of their own dhildren. The results are 
sunroarized in Table 25. Of the respondents. 81% reported that 
they had received such -information about achievement tests 



Percentage of Parents Re; 



Table 25 _ - 

Kiftds of Feedback Regarding Child's Tests 



Kind of Feedback 



infonoation received 



Had to ask 
Without asking 



Ponn of transinittal: 
Individual conference-teacher 
individual conference-other 
Parent.raeetihg 
Teacher letter 
Other school letter. . 
score ?eport-no explanation 
Score report-with explanation 
Teacher message through cliild 
Cdnverfiat.ion with child 



ftchievement Tests 
• (N«2i7j 



Yes: 80.6 



Not 18.4 
Unsure:, 0.9 




33.1 

lip 

3.0 
4.5 
2.2 
8.9 
26.4 
1.5 
1.9 
2.6 



' Mental Ability Tests 
(N=192) 



. 39.1 jo:54.7 

' Unsure; 6.3 



61.2 
38.8 



33.3 
35.6 
3.3 
1.1 
2.2 
7.8 
12.2 
l.l 

i.i 

2.2 



1 

(0 

I 



Lentagea tasad on total n*r of reaponaes given, ao.e parenta reported .bre than one 
form of transmittal. 
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and i%% that they he.d received it about ability tests. *here 
~was"generally less certainty about ability tests: 6% of the 
respondents indicated that tl\ey were not sure whether or not Idi^y 
had received ability test feedback, and 31 i^rents failed to 
answer this question. It is quite likely, of course, that inmost 
of these cases no mental ability . test had been administered 
to the particulai; children. 

The remaining percentages in Table 25 are based only on 
respondents vAio had received information on the appropriate 
type of test. Of tnese, nearly half (45%) said they had to 
ask for the informzttion in the case of aciiievement tests, and 
well over half (61?S) said so in the case of iibilit^ tests. The 
next question pertains- to the form in which the feedback v^s 
transmitted. The percentages refdr to the total frequency of 
each form^of transmittal reported; some respondents had received 
information in more theui one way. 

About a third of the communications regarding both types 
of tests were received in an individual conference with a teadher. 
For ability tests, a slightly larger percentage (36) were trans- 
mitted in a personal conference with another school official i 
Only 16% of achiev^enc test cbaamunicatidns wiare received ^ 
tiiis manner. A score report. with appended explanation was the 
next moat frequent mode of conmunication^ accounting for 26% 
of the trcuxsmittals fon achievenent tests and 12% of those for- 



.;abiiity tests. S6qre reports t*±thout expianatibh-a accomted 
for 9% md 8%, respectively. Other forms of connoonication ' _ 

were relatively infrequent. It might be noted that only 3% 
were received at i parents' meetings, vdiere the nature of Sie 
tests and the interpretation of scores could be explained to 
the group. While written summaries of the individual results 
would bo distributed to. parents. ^ 

■ Although it is gratifying to find that the more desirable 
means of trahsmittal predominated, Sie appreciable frequency 
of btiier* leas comnninixsative procedures , is disturbing. This 
situation ia highlighted by some of the free responses con- 
tributed parents in conhectioh with other, unlisted means 
of transmittal. Seven parents had deceived the feedback from 
a clerk, secretary, or sdiool office w'Srker^; five had received 
it on the report card or attaSed tb it; two received it in a 
telephbhe conversation, and one frow a teacher she had met in 
the supermarket. . 

Parents were alsO asked to indicate hbv useful they had 
found the. feedback they had received. This riibtibn was re- 
corded on a nihe-pbint rating scale ranging frbm "completely 
useless" (1) Sirough "fairly useful" (5) to "actr^ely useful" 
(9). The means, reported in Table 26 .indicate that the group 



^Six were from a single School. 



parent Ratings of Effect of Own Child's Test Taking 



3^ 



Effect 



2nt Tests. 



N 



Meem 



SD 



Mental Ability Testa 



N 



MesLh 



SD 



Usefulness of 

feedback . " 

Effect of testr , 
takings experience 



177 



191 



5.00 
J. 07 



2.41 



1.72 



94 



1^ 



A^81 
Q-=.28 

5.23 

cr=.i4 

M 



2.74 



1.52 



tlQte . Scale 1-9^ obtained, range 1-9 for each item. 
High scores indicate favorable attitude. 
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fbund adhiev^^ftt te^forma1:ioft fairly useful,, v^ile ability. 
t.st ix^f^atioh: i. rUed^ess Useful ^ a small and statistically 
in^gnificaSt amount- - ^ '^^^^ 

gli^n by individual patents r^ged from 1 to 9. 

in an ^pen.ended Uestion, respondents w«re ^a^ed what . 
they believed ,«.e sdho^I^rjeacher Sight have done, [to inform 

a.e« better al^ut their. i;^^ 
of suggestions accounted ior nearly ab-^^ 
parents recoHon^ded increased f^e<a,ack, prdSarily^^rough con- 
ferences to explaiA the child's strengths and weaknesses; 27 , 
asked for explanations ,^ut the purpose of the teat and its 
implications for the child; and 15 suggested'' that parents 
should be automatical^ informed about test results rath.r than - 

having^ to asl^^^ir^ai^m. 

. Finally, par^ts wer^ ask^d to evaluate the ef fect^hat the 
test-taking expedience had h.d on tbeir own <*ild. The two rating 
scales used for ad^iev^ent and ability tests ranged from -qrite 
harmful" (1) , through "no effect" (5) to "quite helpful". (9) . 
The mean ratings for boQ: achiev^ent and mental ability tests 
fall virtually on the "no ef feet " rating (5.07 and 5:23) ., It 
Should nevertheless be noted «xat the ratings assigned by in- 
dividual parents again ranged over the entire acale, from 1 to 9. 
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Teafe Qoinion Xnyentory . Sie same inventory used to assess 
She attitudes of teachers toward testing was administered as 
^e last section of the Parent Survey. Table 27 gives the means 
and standard deviations of the ratings assigned to each state- 
ment. vSiie the entire scale range (1-9) was utilized for 
each item "by individual respondents, most of the group means 
cluster around -aie scale midpoint* suggesting a moderate attitude, 
"gi^ce the standard errors of the obtaiked item means range from 
•16 to .19# a conservative estimate of a statistically- sighi'fi;^ 
cant deviation (p <.01) from the theoretical value of 5 is 
indicated by dif ferehces of approxima4ely +0^5 or higher. ^ ^ 
Five of aie item^ have mi)ans that do not differ significantly 

from 5? tiiese^ are Items 6> 8*' 9, 10, and 13.. 

-X ■ ■ ■ ■ _ - ■ ._ • _ • 

Let VIS now consider the ten items whose means do' deviate 

"atghificantly from, &e neutral value. Of these, half demon- 
strate a favorable attitude toward tests* three through rejec- 
tioh of adverse statements and two through acceptance o^* favor- 
able Statements. In . order of mii^itude of - deviation/ the rejected 
adverse statements include Items 2 (testing is ah insult to 
htonaii dignity)* 12 (eliiaifiation of all standardized testing in ; 
educational system)* and 11 (ability tests diactiiain^te against 

_ ■ - : ' - ■ J - - - 

minorities ) i ^Hie two showing strong acceptcince of favorable 

Statements are Items 15 (properly used tests prevent unfair dia- 



ant i^'' 
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Item So. 



>* 1 
2 
3 

^ 4 
^* 5 
6 

* 7 

8 

* 9 

* 16 
II 
12- 
13 
14 

» 15 



Table 2V _ 
Parent KesponseB to Test Opinion inventory; 



key Topic 



Ability teits help instractipn. 

Testing and hpan dignity. ' _ _ . _ __ 

Interviews vs. tests in college admission. 

Testing too widespread in our' society. 

IQ tests and instructipnai decisions. 

Tests underpredict minority school achievement. 

Reading tests aid teachers, 

Tests measure rote meinbry/ 

Test scores independent of appearance. 

Tests, cultural handicap8,and reniediat;idn. 

Mental ability tests unfair to rainbritl^es. . 

Bliiihate all standardized lestsin eduijation. 

National norms encourage con^etition.' \ 

Measuring only a few traits is harmful. ; 

Proper test use prevents unfair discrimination. 



.Total Score M = 75,85 <^ = 1.53 



Mean 



' SD: 



4 14 


2.48 


3 47 


2.46 


E 14 


2.30 


5.71 


■ 2.55 


4.44 


2;49 


5.14 


2.;4i 


5.81 


2.53 


4.85 


- 2.32 


5.12 


• 2,48 


4.72 : 


2.44 


4;39 


2.60 


3.79 


2.54 


5.03 


2.74 


5.55 


2.51 


5.93 


' 2.38 



OD 
I 



SD =20.82 Range- 17.27 = 



Note. Scale 1-9, obtained range 1-9 for all items. 
~". Eow scores ^indicate favorable attitude, except on starred items. 
For item responses N = 209-218 
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crimination) and 7 (standardized reading tests are helpful 

to teachers). / 

ftn equal number of items yield significant deviations in the 
unfavorable direction- Of these > three represent acceptance 
of adverse statements w They include > in order of magnitude of 
deviatidnr Items 3 (interviews should receive more^weight that 
testi in college admission), 4 (testing /is too widespread in 
bur society), and 14 (measuring only a few traits is harmful). 
Two represent rejecrtion of favorable statCTients, namely Items 
1 (Siiity tests help instruction) and 5 ("IQ" tests aid in- 
structional decisions). 

in general, the response patterrf of these parents shows a 
rea^dnable and thoughtful differentiation between the more . 
extreme and the more moderate statements^ whether favorable or 
unfavorable. There is some indication of a more unfavorable . 
attitude toward ability tiian tov^rd achievement tests, illus- 
trated by Items 1, 5, and 7, and a concern witii the proper use 
of tests (Item 15) rather tham a blanket objection to all 
.standardized testing (Item 12). Oliere is also evidence that.. 
the group as a whole does not regard standardized tests as such 

to be unfair to minorities ' (Items 11 arid 15). 

_, ' ' ~ _" ~ " '* — 

^e total inventory scores yield ah internal consistency 

coefficient (alpha) of .85. There is thus sufficient interitem 

behavioral consistency to justify the use of total scores as an 

i ^ 
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index of ^.meaningful attitudinal conitruct. The mean total ^ 
3Core ii 75.85, v^ich coincides closely with the neutral or 
moderate value of .75. The range of individual differences is 
,.ide, extending from 17 to 127. ISx^ extreme score of 17, which 
falls close to the po.sdile minimum of 15, was obtained by a 
single atypical respondent, tixe next higher score being 41. 

one of i^e hypotitMes we Wished to test regarding communication ^ 
was that parents received feedback about their children's 
test perfo:^ance witi^out having to ask for it would have more 
favorable attitudes toward testing than would thos. received 
^ feedback only after asking for it. Table 28 summarizes 
t*e data relevant to . this hypothesis. The indiies of parental 
attitudes (depend^t vari^l.s) exaxoined for^ this purpose 
include the ratings on overall use of t..ts wiS schoolchildren 
(Tabl. 22) , the ratings on having one's oWn child tested (Table 24, 
^d total .cores on the 15.item Test Opinion survey (T^le 27). 

It will be seen in Table 28 that, with regard to feedback 
about achi^^^^tests, none Of the S^ree differences reaches 
statistical Significance, Although all three ar. in the hypcthe- 
sized directionl^ WiS mental ^ild^ tes^/ ^^^^^ fee hypothe- 
sis is supported at l^e .01 level on the first question, and at 
the .55 level on t*e second question and the inventory scorei. 
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' Table 28 _ 
Reiatibn TDet^^yeen Testing FeedDb^^ 
and parental Attitudes on Testing 



Attitude Measure 



Without 
Asking 



Bad to 
Ask 



t- ratio o£ \ 
Mectn bifferehc( 



Feedback about Achievement Tests 















M 


6.23 


5.75 


1.40 


Overall Use of Tests 


SD 


2.28 


2.32 


df 176 


in Schools 


N 


98 


80 


n.s. 




M 


614 


6.03 


.31 


Approval of Own Child 


SD. 


2.56 


2.50 


d£ 176 


Being Tested 


N . 


98 


8b 


h.s: 




M 


75.30 


74.67 


.18 


Test Opinion Inventory: 


SD 


22.12 


19.26 


df 143 


Total Score ^ 


N 


82 


63 





Feedback about Mental Ability Tests 




one- tailed test. 

All items* scored with favorable ratings hign; possible range 15-135, 
neutral score 75. 
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^.a Contrast between the achiev«D^ht : and ability test 
result.^ is even more conspicuous when we recognize aiat the 
xnatfber of parents received in foiSit ion about ability tests, 
wis. 6r wiic^ut having to ask, is much smaller thah the number 
receiving achievement test information. Hence large differences 
were required to reach, statistical Significance with the ability 
teat results. -Bxis contrast in results is consistent with the 
finding S^oughout our study that the distinction between a^ieve- 
„ent and ability tests is very real for parents as well as for 
school personnel.' Regardless of the minimal intrinsic differences 
i„ the nature df the two types of tests, they are used in different 
ways, largely by different persons, and in different Situations. 
And they are differently perceived by parents and teachers. 

With reference specifically to the attitude findings. re- 
ported in Table 28, we can speculate that achievement test feid- 
back was perceived by parents in a more routine fashion, as an 
adjunct to regular sciiool instrudtion. Thus the form of communi- 
.cation and the conditions under which it was received had little 
. ionpact on parental, attitudes toward testing. Feedback on mental 
ability' tests, on the other hand, was in a different category. 
These test scores have more emotional significance and ego , . 
involvement; «iey are more likely to b^ misinterpreted and mis- 
uied; and- at least in some of «ie schools surveyed, they were 
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hot rbutihely administered in group sessions, but were given 
to individual children for special reasons by a s.chool psycholo- 
gist or other professional specialist. W:iBh results of such 
tests are regularly conmunicated by the school on its own initia- ' 
tive, they are more likely to be adequately explained. As a re- 
suit, the parents will be more receptive to the heed for such 
testing, the use, to be made of the results, and thd ifiterprata- 
1 tioh of the scores. If the parent had to ask for such feedback, 
on Qie other hanql, he or she probably learned that an ability 
test had been given to the child and may have decided to ask 
for the resiilts because of apprehension generated by that know- 
ledge. The kind of feedback received under these conditions 
m^y also have been less adequate and less reassuring, because 
the school may not have had effective established mechauiiams for 

transmitting such informations 

-■ ' \ ■ ■ .*_ I ^ __■ __ 

The causal relation between requesting feedback and atti- 
tude .toward testing could, 6f course, have operated in the reverse 
direction in spme ca^es. .^Parents v^o are suspicious of tests 
or hostile toward their* use may be more likely to ask for 

feedfiack vtfieh their child is tested, so that they may detect 

' J ' . ■ . . .. . 

.-/ anticipated misuses aihd misihterpretations and may complain about 
/ them. But tixis attitude itself is likely to have developed as a - 
result of cumulative past experience regarding tests. Adequate 

/. and correct communication is certaihly ah effective means of pre- 

■/ • • ■ . ' ' '. . . 

/ ' . ■ , . . 

/'■/ : ■ ■ . ~ ^ ■ ■ : . .: - ..' . 

/ / . ■ . • 114 ■: 
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vehting atich 4 favorable buildup °f "^^^ /^^^^ _ 

over to subsequent test use. 

.r ^^i.^^^ ^^ ^ Resenn^e^i nf Black Parents 

The sample of 223 parents who participited in this study 

^ included only 7 blacks. 2 HiSpanics. 2 orientals, and 2 American . 
Indians. It is aK,arent that minority populations were not 
represented in sufficient nu^ers to justify separate analyses. 

•Nevertheless, we decided to examine the responses of the seven 
black parents. Irom the viewpoint of descriptive rather San 
ix^ferentiML statistics. Because of greater demand, on their time, 
black par^t. as a vSole ar. probably less likely to participate 
in FH, activities th^ are white p^ents. Consequently, those 

, Who do participate are probably a more hi^iy selected sample 
. wife rigard to interest in educational matters and knowledge 

^ about educational probl^s. It was thu. felt «.at the r..ponseB 
of our' ^11 group of conceded ai^d knowredge^le black parents 
were of interest in their o^m right. 

Participant ^aracteril£±S2.. ^^^"^ parents iitcluded 
six females and one male. Age distribution is similar to that 
6f.^e total .sample, with four^ persons between 30 and 39. one in 

^20s. and 2 in the 40s. Bie group had a total of 10 children 
4 school, ranging in age from 4 to 17. with a mean age of 10 
yearsi Nine attended piSiic' schools, one a parochial school.^ 

^titudea Warding st^dardi^ed Tgits. Our arialysis con- • 
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cehtrates on those parts of the parent survey in which attitudes 
toward testing were explored through various approaches i .ihese 
data fit into a meaningful unit t±iat provides ah opportunity 
for internal aggregation and corroboration among the various re- 
sponses. Because of the small number of cases « it was not con- 
sidered productive to analyze responses to isolated items dealing 
witii different questions about teit use. All the findings from 
our analysis of black parent attitudes have been assembled into 
two tables^ in which Uie reiSponses of the black group are com- 
pared with those of the total parent: sample. 

Table 29 siammarizes the ratings obtained in response to 
various items^ in different parts of the inventx)ry . Looking first 
at the cOTparative evaluation, of test uses, we find the mean 
ratings by black par^ts to be fadLrly similar to those from the 
entire sample. For adhievement tests, the most conspicuous 
differences aire the somevSxat stronger disapproval of using these 
tests to influence cariser decisions and the stronger .approval 
of tiieir use for identifying tiie intellectually gifted. For 
ability tests, t±ie. black parents express somewhat stronger 
approval of the overall use of these tests, as well as of their 
Tise for giving eactra ihatructibri and identifying learning dis- 
^ilities. They express somewhat stronger opposition to tiie 
use of ^ility ttsts for tracking decisions. 

^s^Approval of having one* s own child tested shows little 



QueiEton 



overall use in ichoola 
TMcking_deci«^ 
mn inatructibn : _, 
iheiuehce csrior plans 
Intellectually gifted 
Learning diiabilitiei 

\ Rpprove of own chlU 
• ieing tested 

UfefulheiBB c£ feedback 

Effect ol tdBt*taking 
experlehce 




H 


SD 




DM 




6.04 


■2.29 


6.29 


2.22 


3-9 


5.3? 


2.61 


7?i 


3.08 


1-9 


7.43 


1.89 




1.46 


6-9 


4.38 


2.55 


3.43 


2.88 


1-8 


5.6t 


2.69 


7.00 


2100 


4-9 


5.49 


2.75 


5.14 


2.73 


1-8 


6.03 

It 


_ ^2.50 


5.71 


3.40 


1-9 


s.oo 


2-.41 


6.50 


1.70 


4-8 


'5.07 


1.72 


6.60 


1.14 


5-8 




5.45 
3.6Q 
6.37 
4.07 
5.41 
5.25 

5.56 



4.81 
5.23 



2.74 
1.53 











2.42 ' 


:6.29 


.2.98 ' 


2-9 


2.S9 


4.00 


2.83 


i-8 
3-9 


2.34 


7.00 


2.31 


2.44 


3.71 


2.63 


1-7 


2.77 


5.71 


2.43 


2-9 


2.70 


6,00 


2.38 


3-9 


2.65 


5.57 


2,94 


1-9 



6.00" 

7.50' 2.12 6-9 



^. scale 1-9. high .coree Indicate favoraSle attitude 
J, Range 1-9- for all Item In Totil Group • 
^ Roationstt by a ilngte perionj Whi gave a rating of 6 



I 
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differende between blacks and. the total group. Both usefulness 

.... • tt o ' 

Of are testing feedback and effect of the test -taking experience 



oh their children are given more favorable ratings by the black 
parents^ and this difference holds for both achievement and 
ability tests. _ - 

Table 30 provides a comparison of the riasponses of the 
black parents: and the total sample on the Test Opinion Inventory, 
we note^ firsts tiiat this small group of black parents tends to 
e^^ress more extXCTe attitudes. Their iteim means range from 1,67 
to 7.60/ while, in th^ total group tii^ range" is from 3^.47 to 6.14. 
Moreover^ in. the black group, seven itraa receive mean ratings 
of 6 or over, in contrast to only one item in the total group, 
^e dis€fibution of high and low ratings assigned to items favor- 
able and unfavorable to testing, however, is sudh asito indicate 
no overall attitude difference between the black group and the 
total group, ^is is cbrroboratnd by the total inventory scores, 
in which tiie black mean (75.60) is virtually identical with 
lAe total group mean (75.85). it will be recalled, furthermore, 
that this mean coirresponds to Uie theoretically defined neutral 
value of 75 fl5x5). These findings suggest that^ even more than ^ 
the total group, these black pci^ents expressed clearly differen- 
tiated views, rather- than an overall bias for or against testing. 
Their responses tend to show disapproval of real or potential 
misuses of tests* while favoring proper and constructive uses. 



Table 30 



Coiiiparative Responses of Black Parents to Test Opinion inventory 




1 
2 
3 
4 

'5 

:6 

7 



* 10 
11 
12 
13 
14 

* 15 



■8 I- 
9"^ 



^ility tests help instruction. , 
Testing and human di|hity._ " . ' ' __ 
Interviews vs. tests- in college adiission. 
Testing too widespread in bur sbcietyf. 
IQ tests and instructional decisions . 
Tests underpredict minority school achievement 
Reading tests aid teachers . ■ 
Tests measure rote memory^ 
Test scores independent of appearance. 
Tests* cultural handicaps^and remediation. 
MentSL ability tests unfair to minorities. ' 
Eliminate all stahdardized tests in education. 
,; Hationil norms encourage competition. 
Measuring only a few traits is harmful ■. 
proper test use prevents unfair discriminatipn 



Total Score 




P5.85 Range-17-127 
SO=20.82 



4.17 
,2.83 
6.17 
5.16 
5.50 
6.50 
5.83 
5.83 
6.00 
5.50 
6.50 
1.67 
7.20 
7.00 
7.60 



,3.13 
3.13 
2.71 
3.^2 
3.21 
2.95 
*2.04 

2.00 
3.02 
5.33 
1.03 
1,48 
2.10 
2.61. 



Ir9 

1-9 
1-9 
1-9 
1-9 

1- 9 
3-9 

3- 9 
.4-9 

2- 9 
1-9 
1-3 
5-9 

4- 9 

3- 9 



0 
00 
I 



H=75.60' Range-48-lOO 
SIJ=20,48 




mM, LOW item scores favorable, but scale reversed on starred items and in total. score. 
* All ranges 1-9. 
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0 ir^ . 

Ah exadriihation df the individual it^s yieldiiig means that 
deviate by one point or more from the theoretical value of 5 
dilustrates thisl responisie. pattern. Of the 15 inv^^qry items; 



nine vioid meahs at or beyond these limits. Foiir df these 
•iteps indicate a favorable attitude toward tests. OSiese include 
two very strong rejections of adverse statements » which char- 
acterize testing as . an insult to human dignity (Item 2) and • 

advocate the elimim tion of all standardized testing in the 

- - •■■ - ^ n . --- -- ' ^ • ' 

educational system (Item 12).' The other two responses repre- 
sent strong acceptance of favorable statements, referring' to t3io 
- i^artiaii^ of tests vfliich are linaf fected by appearance and 

manner (it^ 9), and to the function of properly used tests in 
; preventing unfair discrimihatioh (Item 15). It is noteworthy 
that both ♦of aiese statraents recognize the potential value of 
tests for minority groups. Both show stronger aqceptance by tlie.<5; 
blacks than by the total #roup.' - ' . 

Five responses represent unfavorable opinions regaiding 
tests. All of these indicate acceptance of adverse statements. ; 

In order of magnitude of deviation; tdiey include items 13 

- . ■- *• • * 

(standardized tes1?s encourage comjpe tit ion with* others rather 

than self-imprdvanexit) ^ 14 (tests too limited in ability coverage); 

6 (tests underpredict s6hoolJ|achievement of minorities) , 11 ..(mental 



^ Despite Sie* small number of cases, thi^ item-mean deviates 
significantly from 5 at pv^.Ol^vow^g to Uie narrow ramge aind 
low SD. ' : ' ; 
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atoiiity tests discriminate against minoritiii) . and 3 (give 
more weigSt to interviews than to test .cores in college admission) 
'The last of the^e (Item 3) yields virtually the saSi mean as 
•in- the total g^oupr the Otiier four show stronger agreement with 
.the stated criticism amdhg tiie blacks . In ali thef e statementa. 
one can see evidence of possible past e^qperience with the kinds 
6f .misuses and misinterpretations of tests than can have more 
adr^erse effects on minority than on majority atudents. 
-n^ ^^tive f ri ^L^^ Pa ^nh knd-^aHi>-ir ResT^onses on ^geat 

Qoinibn inventory 

The Teat Cpi-nion Inventory wai administered in the identical 
. form to all parent and teaciher apples in our study. Table 31 

brings .4;pge«.er the°resuits obtained in both groupa. including _ 
^ it«n r^api^naea and total scorea. To begd^ with total scores, 
we find virtual identity in g^c^up means, both falling practically 
ori the theoretical midpoint of the scale. -Hie parents, however. ■ 
aAiSit wider indiv^al differences . .with 'an ' SD of 20 .82 as 
comparid with 15.20 for the teachers.^ ^ " « , 

With- regard to; individual 2te&^he response pittern is - .■ 
predominantly aimilar for the two groups. / Following our pre- 
viously est^lished rule-6f-th» thaf means below 4.5 and above 
. 5.5 represent significant deviations from the neutiral 5. we find 
four items shewing significant ^orable deviations among the 



Table. 31 • 

CotnpariBon of Par ent and' Teacher RBBponggs on Test Opinion Inventory 



item 


; Key Topic 


......... ■ H 

^Parents 


Teachers 


iio. 


Hean 


SD 




Heat) 


. SD 




* I 


Abilitv tfists he Id instruction* 


4.14 


" 2.48 


,17 


4.43 


2.20. 


.16 


1 


Testing and hiiiah. dignity. ■ 


3.47' 


2.46. 


.n 


3.22 


2.13 


.15 


I- 


Interviews vs; tests in colleqe admission. 


6.14 


2.38 


.17 


6.26 


2.06 


.14 


4 


Testincf too widesDread in our societv* 


5.71 


2,55 


.18 


6.'28 


2.13 


.15 


*;5. 


iQ tests and instructional decisions. 


4.44 


2,49 


.17 . 


4i48 


2,15 


.15 


t 


Tests underpredict minority'' schobl achievement. 


5.14' 


2.41 


.16 


6.28 


2.20 


.16 


* 7 


Reading tests aid teachers. 


5.81 


2.53 


.17 


6.13 


.1.95 


.14 


8 


Tests neasure rote meiiiory . 


4.85 


2.32 


.16 


4.62 


2.11 


' .15 




Test fiCOres indeDendent of a&bearaiice. 


5.12 


2.48 


17 


t .0 J 






no 


Tests, cultural handicaps^ and remediation.' 


4.72 


2.44' 


.17 


4.30 


2.42 


.17 „ 


11 


Hental ability tests unfair to minorities. 


4.39 


2.60' 


.18 






• io 1 


12 


Eliinihate all standardized tests in education. 


3.79 


■ 2.54 


.17 ■ 


3.62 


2. '35 


.16 P 


1^ 


National norms encourage competition. 


5.03 


.:2.74 


.1,9 


5.05 


2.52 


,18 ^ 


14 


Measuring only a few traits is harmful. 


5.55 


2.51 


.17 


5.33 


2.42 


.17 




Proper test use prevents unfair discrimination. 


5.93 


2.38 


.16 


6.37 


2.00 


^.14 


Total Score 

1 


M =1 75.8,5 SD. 


= 20.82' 


41 = 


75.40' 


SD = 15.20 --- 




1.53 Range=17rl21 


¥' 


1.14 


Range = 23-118 


ti 















Sete . Scale '1-9,; ranges 1-9 for each item in both groups. Low scores favorable, except on starred items. 
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teacihera (Jbrnma 2, 7. 12, and 15). The parents' meras yiild 
favorable deviations on the same four items, plus one other, 
item 11. (mental ability rtests^ are unfair to minorities). While 
Qie parents reject this item (4,39). the teachers accept it 
(5.59), the group difference being significant at p-C.Ol. - 

A total of seven item means indicate significant unfavorable 
aittitudes for the teachers (Items 1. 3.. 4. 5, 6. 10, 11). Four 
of these items show a deviation in the samis diredtion for parents. 
The three items yielding inconsistent group "^responses include the 
previously cited Item 11, whi^ deviited in opposite directions 
in the two groups, and Items 6, and 10, with significant unfavorable 
deviations among the teacaxers but no significant deviation from 
neutistlity among the parents . Both of theie items deal with the 
use of tests with minority groups. The It^ 16 mean is signifi- 
cantly different between the two groups; the Item 6 mean is not. 
In addition, one item mean {Item 14) just barely faili into the 
aignifiiant unfavor^le range for parents, while remaining in the 

neutral (range for teachers. The group difference in this item 

! ■ : • - - 

does not; itself reach statistical significance, however, and the 

i _ ■ . * i: " 

finding is probably negligible. 

Thik rapid overview of item' responses on the Test Opinion 
inventor^ indicates that teachers tended to be more critical of 
tests than were parents in certain specific situations, all 
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involving the use of tests w±^ minorities. We could speculate 
that the teaciiers have witnessed and been involved in more mis- 
uses of tests .with minority children than have the parents ^a^d 
are more often responding in terms of these mii3uses rather than 
in terms of potential constructive uses. ' 

DISCUSSION 
Overview . ^ 

Our specific findings regarding the cTirrent use of tests 
in the schools have. been summarized in the three major sections 
of this report. In those sections, tiie factual results were 
presehted in relation to the^ part icu lax c[uestions we set: out 
to ioiswer with each of our participant groups: teachers/ testing 
coordihatx)rs> and parents of schoolchildren. 

In our study of 207 teachers ^ we wanted to know what functions 
tiie teachers th^selves perform in testing; how they use test 
scores in their teaching; how useful they consider standardized 
achievement and ^iiity testis and how Siey think their useftal- 
ness— can be improved ; what ^re their atititudes toward the use 
.of standardized tests in the educational sysr^ in general; to 
v^at extent they have acquired the backgrotind knowledge needed 
for the proper interpretation of test results; and what is the 
relation between their . mastery of this body of knowledge euid 
their attitude towcurd test^. 

12E 
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in the interviews witi. 15 tesMS2 egQ^dinatora . we were 
prinbipaliy interested in learning on ;What bases and by whom 
deciaona abo«t tests and testing programs are made. At the 
same time, we were able to obtain clarifying and supporting 
information on severii questions raised in other parts of the 
stiidy. The data we collected from the testing coordinators 
occupy a special place in our study/ for at least two reasons. 
The first pertains to Sie intrinsic features of the interviewing 
technique, including the ridhness of detail it can provide and 
the opportuhits^ it affords to coordinate and integrate the dis- 
crete facts 5btained from any one respondent, second,, and 
equally- important, is the key position occupied by testing , 
coordinators, not only in influencing testing decisions but 
also in transmitting knowledge and attitudes to the grass-roots 
users of test resulti in the schools. 

in our survey 'oi 223 parents , we investigated their attitudes 
tov«trd different uses of standardized achiev^ent arid ability 
tests in the sdiools; how much they know ^out the ways in which, 
tests are actually used in their own child's school; how they 
fiel about their own child being testid. and whether they 
would prefer an increase or a decrease in such testing; whether 
they received feedback about their child's test performance, and 
if so. Whether they had to dsk for it or received it without 
•^asking; how the fei^ack was transmitted to them, and how useful 

. 
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they fotand it; whether thesy believe testing has had a helpful 
or harmful effect on tiieir diild; their attitudes toward the 
use of stamdardized tasting in the educational system in general; 
and whether sucii attitudes show any relation ' to tixe conditions 
of feedback transmittal. 

■The answer^s to tiiese specific questions can be fotind in 
Parts I # IT, and li of this report. Further condensation auid 
stanmary of tiie results would be redimdaht. In the present sectioi ^ 
therefore, we will highlight certain broad conclusions of special 
significamce. TheiSe conclusions are supported by findings from 
different parts of tiie study, or from different questions asked 
within any dxie part. 

Coromunicati,Qn in Relation to Sta nd a rdiz e Testing and Test Results 
The aura of confusion and malaise that surrounds con temporaury* 
testing has multiple causes and hence calls for multiple remedies. 
In Sxis study> .we have cohcehtrated on one cause, v^ich we con- 
sider to be among the most importEiht. That cause centers oh 
coimunication^ broadly conceived and operating oh several levels. ^ 
At the simplest and perhaps most direct level> there is heed for 
improving feedback about test results to teachers, school adminis- . 
trators, and parents. 

At a more fundamental level, tiiere is need for wider and 
more effective dissemination of testing knowledge to test users. 
This calls for accurate amd up-to-date information abdut the 
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nituri and function of testa, th^ meaning of scores oH standar- 
dized tests, and the findings of behavioral science tiiat are 
relevant to the proper interpretation and application of test 
results. This ^pe of conmnmiction requires different forms 
of transmittal and different content and language to adapt it 
to the needs of the general public, parents of schooldiildren, 
teachers, and other educational personnel involved with testing 
in various capacities. There is ample evidence froS a variety 
of sources tapped in our study that the current means of 
communication in this area have not provepd effective with any 
of the publics to which they are diredted. 

At a third level, we need to keep open the channels of 
cormmmicatioL fr^ teachers and paints to school administrators 
and to test piilishers and authors. Because of the inadequacies 
of communications ^ut testing m teachers and parents, mig- . 
conceptions and misuses are still prevalent, ftu^mented conintuni- 
cation fr^ these sources can help to identify such misuses and 
can in. turn identify the kiiids of information about testing 
whose transmittal requires strengthening. 

^a>e SpeeizUL Need s of Teachers 

That teachers as a group dc^not have sufficient prerequisite 
information ^out testing for the proper interpretation of test 
scores was indicated by the results of the Test Usage Inventory. 
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Thia is a 15-itira raultipie-chbice inventory designed to sample 
basic testing concepts and types of scores, as well as the 
interpretive context of test results. Both the teasers' total 
scores oh this ihvehtoiY sLiid tiieir responses to individual 
items revealed serious gaps in esiential knowledge. The mean 
total sdore corresponded to harely over fifty percent correct 
responses. Analysis of the percentage of teachers choosing each 
response option in individual items revealed cphfusiphs aiid 
incorrect information aibout several basic psychometric concepts. 
Even more disturbing is the finding that one of the items dealing 
with a fundamental interpretive orientation yielded more choices 
for aii incorrect option than for the correct option. To the 
questions "in general* what do mental ability testa measure?" 
the majority chose the response option, "ouiderlyixig cjapacity for 
mental functioning," in preference to "current level of ihtellec- 
tual performance." From another angle > the sharp ihtej^retive 
dif ferent±ation between so-called achievement tests and. so-called 
mental abili^ tests tiiat still pervades the school system con- 
tributes to the perpetuation of outworn stereotypes about the 
functions of testing. 

The acceptance of popular miaconceptiona, aa well aa the 
paucity of correct infdrinatidn about paydhometric concept a, ia 
eapecially noteworthy when we conaider that the group of teachera 

13.0 
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participating 'in this study had a relatively high level of 
education, the largest proportion reporting a Master's degree 
plus further graduate training. They also had been exposed to 
considerable specialized training in testing;- the largest . 
proportion had completed a graduate testing course, and a size- 
able proportion had received various conibinationa of in-service 
training and academic courses in testing. It thus appears that 
the existini training facilities in the schools of education, 
and in-service courses cannot be relied upon to do the v*ole 
30b of preparing teachers adequately for the proper tnte^re- 
tation and use of test results ^ 

It may, also be n5ted that test knowledge, as assessed by 
tixe Test Osage inventory, was significantly correlated with 
•overall attitude toward st^dardized testing, as issessed by 
the Test opinion Inventory. While not large, this correlation 
shows a clearly established tendency for teachers ,^0 are more 
knowledgeable about testing concepts and interpretations to 
express more javorable attitudes toward testing. 

: The black teachers in our 3 Wle- P"^®*^ 
the teachers with the largest number of black students, performed 
more poorly on tiie Test Usage' Inventory a.an did the total sample 
. Th^ also exhibited a significantly n»re critical attitude toward 
testing on the Test Opinion Invento^^ especially , in «.o.e items 
dealing with the applicatidns ^ testing to minority children. 
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This more highly negative attitude may itself be associated 
with their more frequent acceptance of popular misconceptions 
about tests • It may also reflect the misuses and misconceptions 
aiey have witnessed in./^e interpretations others have attributed 
to the test performance of minority children • - 

it should be added Siat^ when asked what can be done to 
improve testing practices, the suggestions offered by some . 
teachers, as well as some testing coordinators ^ called for ways, 
of improving teachers • knowledge ^out teats* Examples included 
wbrfcslibps on testing, fuller explanations ai5out the nature and 
jftmctions of particular tests, arid tnore aids auid guides to 
interpretation accompEUiyihg test-iacore feedback. 

Lack of time is a second major obstacle to Uie ftill and 
effective use 6f . teat scores by. teachers. When some testing 
coordinators eacpreased the opinion that teachers do not make 
use of test scores in their teaching, they were asked why this 
is so. The answer was, in effect, that teachers already have 
too much, to do. Testing and tiie availability of test scores 
merely add to their biardena. Insofar as this 'cnhdit ion prevails, 
it highlights the heed to simplify the tea<dier's task of applying 
the infbrSatibn provided by teats to their day-by-day classroom 
activities, ^is is being done increasingly in the case of 
diagnostic adhievraent teats, through detailed response analyses 
2Uid associated instructional prescriptions provided in ,the test 
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m^al^. and. through alab^ated scor. reports. Also indicated 
is th« need for prif^s.ionaily trained personnel to bridge 
the gap betwe^' test r.^ults and their instructional implications 
in individual cases. Some of teachers' suggestions for tha 
i^provem^t of test utilization ref^rr^ed to additional pro- 
fessionally trained persons in the schools and to professionally 
. oriented and mo^e Icnowledgeable polishers • representatives . 

A ti.ird major problS surfaced in the course 6£ our inter- 
views with- testing coordinators-, several respondents observed 
that genetic explanations of individual differences in test 
performance are often- encouraged by teachers' organizations, " 
School adBiihistrators, and individual teachers because they 
• ..«tplain away^ sdhoot differences in mean scores and in rate 
of progress over time. Tea<*ers certainly need protection 
against improper and unsound accountability procedures. Super- 
ficially, i^ that mean test scores and measures of score 
changei over time provide a readily accessible and objective 

Of assessing t^e effectiveness of t.achers. Such ) a procedure, 
however, ignores "the powerful influence on student performance 
and progress exerted by home and family, peer groups, ahd the 
. community at lar^e. And it ignores the -contributi6ns of antece- 
aerit^ experience to the student's readiness to learn at any academic 
level. Actually, the proper use of student test performance as an 
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index of accountability for evaluating teachers, instructional 
programs, or schools iequires sophisticated experimental designs 
in order to Bstablish causal relations, and to allocate effects 
to the appropriate variables (McDonald, 1976). 

SvQDstituting a genetic explanation in place of a propeir 
uhderstanding of t±ie modifiability of developed ^ilities is a 
way of seeking protection from an unsound accoxitttability^practice^^ 
by promulgating; a. fallacy. It is a fragile defense, and one that^ 
creates other problems*, such as the rejection of testa. If one 
b^ina by. assuming that tests are supposed to measure innate 
potential, tiien, v»hen it is demonstrated that scores reflect 
individual differences in prior experience — as can certainly 
be done r-- the tests are branded as invalid* and biased. 

^ e Cbhc erns of Paurents 

^i^^^asically^ pMehts are concerned about: possiSsle misuses of 
tescs, which may jeopardiize their child's subsequent educational 
progress. This concern was manifested in various ways in answers 
to our questions. Parents expressed more satisfaction with achieve 
ment than with aSili'^ tests ^ as did teachers. This reaction may 
reveal tfxeir good judgment in preferring the more forthright, 
reasonable^: and objective interpretations of performance 
traditionally associated witii achievement tests to those tradi- 
tionally associated with ability tests. If one must live in the 
1920s, as some educators and even a few test constructors seem 

134 
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td be doing, tiien indi^d achiev^ent tests are. more acceptable 
than aie test, of: academic altitude; intelligence, educatxonal . 
po.ential,^ntal abili^, or any dth.r tests witb s^isby labels. 

. in -axetr eva-ltiation of different use3 of tests, our group 
of parents evidenced thoughtful discrimination rather than a . 
generalised positive or negative bias toward^ testing. For 
ix»stance, the use of test, for deciding>.ic* children should 
receive additional Slstruction was rated high. Testing io 
identify gifted children ^d children with learning disabilities 
also received favor^ie mean ratings. *he use of teats for 
tracking ahd^eir use in influencing career decisiqna, however, 
tended to be disapproved. ^ " , v. ' 

The parents' responses in the Teit .Opini.^ I^ory were 
ec^ally diaeri^ix.atihg. Of 15 it^s in thia inventory, 10 
yielded mean: responses indicating a significant deviation from ^ 
a neutral attitude, 5 in a favor^le, and 5 in an unfavorable 
direction. In general, favorable attitudes were repressed by 
strong rejection of «ctre«e test criticisms and strong acceptance 
Of stat^aents in^lying proper te.t uses. ^ unfavor^le reactions 
indicated objection to the purely roUtine use of test scores, and 
a recognition of the heed for other data in reaching decisions. 
They also revealed a auspicion of teats labeled ■'IQ-ahd thoae 
with the more innocuous bUt rxot. sufficiently^ ||kaauring "ment^kl 
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ability" label. 



Our survey also indicated that these parent groups were 
hot, ory the whole we ll-inforitied about the way tests are actually _ 
being ^sed in their children's schools. From a fourth to more , ,^ 
tiian a- half did not know whether or hot tests were used in 
making various kinds of educational decisions. When 'asked whether 

they approved of "aieir diiid' s .being^ tested^ the mean response 

'_ 

was on the favorable side, of the scale. Mien asked about tiie 

amount of testing, tile largest percentage expressed satisfaction 

_ _ , \ 

with the current eunduilt. Aindng those who wanted' more testing, 

the most ' frequent reason given \ms that it provides, feedback to 

parents and follow-up iQ^brmatiori. ^ It might be noted that we 

also heard practically the same statement from those testing 

Goordinatbrs y^o gave us their impressions about parents' 

attitudes toward testing i Jtoohg the principal reasons/ given 

by those parents Who ^^nted less testing was that tests are useS in 

making unwaurranted judgments and in labeling children — and 



bresumably this kind of label is attached with long-lasting giue^ 
^ Viewing parental information from another angle, we explored 

^ ■ ------ J - 

the kind bf feedback parents received about their children's test 

■ J- ' _ - - -J . 

perfonhajcice. A sizeable percentage reported t^ey had not received 

. ■ • . _ .... : 

testing feedback or were uncertain about it. /Among those who had 

■ ^ ..' . . - - --./--, - - - . - 

received it, nearly half reported that they/ did so only after having 
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asked for it." ±t is interesting to note that, on the Tiit 
opinion inventory, those v^o had ridiiVed information wi^ail 
having to ask for it expressed a significantly more favorable 
attitude toward tests Shan did those who' had to ask for it. 

The mettiods. of transmittal of the test-score information 
varied, coniider^ly. fee more desirable methods - those pro- 
viding some opportunity for discusiion or explanation - were the 
most frequent. Neveriiel^ss. several routine anc^ less conSunica- 
tiveprocedu^^s were still followed ail too ^oft^n. This situation 
was reflected in tixe parents ' comments ^ut ways to make the 
feedback more useful to themX The suggestions given by nearly 
at respondents centered on more explanatory feedback, including 
a discuisioji of the child's strength^ .and weaknesses, as well 
as information ^out the nature and puri;ose bf the test. Also: 
recotiSended was the regular receipt of feedback without having 
to request it. 

Although the number of black parents in our study was too 
small for drawing genera livable conclusions, the reactions of this 
small sample are of interest in that they corroborate «.e findings 
of recent polls (e.g.. Gallup. 1979). as well a^ the views 
expressed by many black educational leaders . Essentially, our 
.resuits suggest that these black parents were cognizant of the 
value of properly used standardized tests in furthering their 
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children's educarionai progress and in coniating racial bias. 

Oh the whole, the findings of our study indicate that 
parents ' misgivings about the use of tests in the schools could 
be met by improved pomznuhication at two levels? first, better 
fee^^ck about Seir children's test results; and second, more - 
dissemination of information about thes nature and functions of 
standardized tests. Mie relatively concerned and knowledgeable 

'_ . . J ^ C _ _ _ 

parents attend PTA meetings, from whom our parent samples 
were drawn, represent a receptive etudience for communications 
about testing. We draw this conclusion, not only from the_re- ^ 
spdnsies' we received in ooir survey, but also frcnti informal 
indications of a strong interest in testing discussions, as 
illustrated by invitations for a return visit by project staff 
smd by reqiaests that a cor^ of our findings be sent to the local 
board of education. 

The School in a S oci e tal Con text . 

Some of the prbbleias about test use, including the stiabbom 
and viable miscdhceptidhs about the meaning of test scores,* deriva 
in part from sdcietal pressures. ISiese pressures reflect tJie^^ct 
that schools are ^bedded in the larger society which includes 

^ J _ " . ^ _ . _ __. ^ ■ • 

government bureaucracies^ the news media, teachers' associations, 

ft 

parent organizations, and a multiplicity df special interest 
groups. Hints about the operation of these pressures surfaced 
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from many sources in pur stu^, but they were especially evident 
in the responsei of t±ie testing coordinators. 

The pressures from different groups interact in complex ways. 
For example, tiie. media stir up and publicize a controversy by 
focusing on statements by a few. atypical waiters, such as. • 
Arthur Jensen. To give Sie; controversy moie news value, they 

-encbtSSge the false impression that these are tiie views generally 
held by psycihometricians and psychologists. With' furtiier dis- 
tortion and simplification, 'tdrat emerges is the notion tiiat 
all intelligence tests are designed to reveal underlying capacitiea 
that are stibte. enduring, and unmodifiable throughout the indivi- 
dual's iife span. Parents become alaSa^d by these manifestly 
absurd claims, v^ich can so readily be diiproved. Minority group 
S«nbers. whose . experiential backgirbund may differ in many ways 
from that of the population on whom the tests ^^e: standardized. 

■ become especially concerned about the implications of using such 
instrtnneritsi - 

; . B^iSting with these highly pcfilicized misconceptions about *. 
What mental ability tests are supposed to do\it, is easy to ded^ice 
•moat of the objections to testing tii^ have been expressed. It 
i'a also easy ^o deduce that the objections Will be stronger on - 
the part of persons with atypical experiential ba^grounds, stronger 
against "mental abillJty" than kgainst "achievement" tests, and 
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stronger against standardized tests witii nationai norms than 
against locally constructed, nonnormative, or so-called criterion 
referenced tests. 

Another exaxaple of ^interrelated societal pressures was 

■_ ___ _ _ __" . ' 

mentioned in connection with our discussion of the needs of 

teachers. Parents, as well as taxpayers who support, pviblic 

education, demand accountability from the sdhools. Partly from 

> . ■ 

test results and partly from other observations, people have 
become aware of a general decline in basic skills and other 
aspects of academic achievement. Some try to hold teachers 
respohsible for the fact that students do not learn as well as 
Siey should. In ah efforj: to defend themselves against this 
accusation, some teachers and administrators, in turn, fall back 
on a genetic e3qplanation of slow learning, thereby accepting the 
interpretation Uiat the media are both publicizing 2Uid attacking. 
Such a defense on the part of teachers also ihtrdduces another 
misconception, netmely ^at geheticaily derived chstracteristics 
are fixed and unmodifiable, while environmentaiiy derived charac- 
teristics are evanescent, temporary, and readily susceptible to 
brief and limited interventions. 

Where does all tiiis leave us with regard to the criticisms 
tiiat have been, directed a.gainst standardize tests? First, in- 
sofar as these tests are occasionally misused and misinterpreted 

" \' ■ * • - ^ 
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in.the schools, the criticisins are justified. Hiis sittiation 
calls for the transmission of more and better informatip^ about 
testing to school >rsonnei. Second, even when tests are properly 
used, aie prevailing negative: attitudes toward tests may be : 
generalized to include all test uses. Prior experience with 
,real or alleged misuses. may lead to the assumption tiiat tests 
' Will be generally nn.sused :to «ie: detriment of children. In this 
case, more effective communications from schools to parents ^out 
test uses with their own children should help to relieve some 
anxieties. The situation will also benefit from wider diisemina- . 
tion of genef ar ^testing knowledge to parent groups and to the 
general puSlic. 

■The Role a£ ^st p tAlishera " 

The larger society in which' the schools are bedded centals 
test publishers. When our testing coordinators were asked where 
tfiey obtained the information they needed to make testing de<=isions 
the large majority replied. that they rely principally on.ihfonaa- 
tion provided by test publishers. Yet these s^e coordinators 
pressed consistent dissatisfaction and distrust regarding the 
information they, received from tiiis source. Several specific 
examples of these reactions we^e cited- in 'our summary of results 
from the study of . testing coordinators . Ih our teacher survey, 
th« respondentswere asked what coSid be done to make the teits ' 
ibie useful to th«n. For both achievement and ability tests, the ^ 
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most frequent responses pertained to the inqproy^ment of fesedbacfc 
from test publishers. Specific suggestions included faster re- 
turn of test scores; further breakdown of scores; and the use 
of simpler, clearer language in explanations directed to teachers, 
parents, and studehts. 

it must be borne in mind, of course ^ that both testing coor- 
dinators and t^adhers had been exposed to personal and written 
communications from many different publishers. OThere is uhdoxibtedly 
wide variadxion among teat piiblishers wiQi regard to the specific 
criticisms expressed by the participants in bur study i it should 
also be recognized that the reported comments indicate the per- 
ceptions Qf tfie respondents, rather than direct observarion of 
the sources of tiiese perceptions* But* of course, it is these 
perceptions that infiuehce attitudes and behavior i ^ 

With thse caveats, we must conclude that all test publishers 
could profitably reexamine their \«*bie systeaa of communication 
with schools. This includes written communications, ranging 
from test-score reports to test manuals, brochures describing 
services and products,-, and special publications designed to 
improve test users ' understanding" of teats and ^e interpretation 
of test scores. It also includes personal: communications in 
cormec-ion with individual' tel^^phone calls and written inquiries. 
It certainly includes the training and orientation of field 
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representatives; it includes the possibility of sponsoring 
workshops oh test, interpretation, conducted for kiy school 
personnel by persihs.wHo are themselves adequately informed. 

in the various parts of tiiis discussion, we have illustrated 
how the findings of Qur study of teachers, testing coordiiStor i . 
and parents support the communication hj^pothesis. Breakdowns 
and inadequacies of dommunication . may lead to misuses of tests, 
as well as to criticisms of teats, both justified and unjustified. 
And improved communication offers a promising ieans of meeting 
these ,problems. ^ » 
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APPENDIX 



Seunple Letters Regarding Confidentiality Commitment 
School Personnel Inventory- 



Interview. Schedule for Testing Coordinators 
Parent Survey 



in 
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Appendix A 

sample Letters Regarding 
Confidentiality Commitment 
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Qniuaut ScKbol of Atts anii Seimce- \ 

FOR D H A M U N I V E R S. 1 T Y 

Depenmetit of PjyeKoioij 



February 26, 1980 



Ma. Jane Doo* Principal y 

•Sho ac^lary Elementary School 
15 Education Road, South 
Shangri-La, Sew York 

Dear Ha. Doe: 

I Wted to Write and tell you Sow pleasant . it^s_|o 
Seet wiSlo^oh e,e fift.enth^|^|3^^ 

niariir vfifitsrdav and we plan to tatK zsij^s cuuw^*y 
f ;a^iS to as^f D^. Zilch ^ -rtti^ ^^^^^ 
.^ITany individuals idSed 

^l^'Sill'S; co^Ste'^o^^. on the o«xer 
-^^.Tfk^^^^^^^- ^Sch.r. complete tl^e <i^»tion- 
til^ will find a»e queationa reaponaive i to^eir 
naires, they wixx f We assure you that the 

f^elinga and not at «l|^^J|;f|^^i^J^t on^e educational 

collect may well have an xxnpacx: on wm« ^ _ 
c^SS^ a^a that^'w^ wili:be able to give you f°»e jae- 
|°rSelack with reapect to your own school. | 
Srd to: seeing you again on March 10^ at 3:00 (or shortly 
before 3^:00) . 



v 



sincerely yours # 



Kurt Geisinger, fh.D 
ftasiatant professor 
Project Director 



,c, br. John Zilch 



Qraduatt School of An$ dnil Scifrices 



FORD H A M 



U N I E R S I t Y 



DerMnmsnr 0/ P^ydioton April 25, 1980 



' ■ cerniiig teaciiers * use of standardized testae as j^ll aa 
their attitudes towaurd taiese tests* I have _taiked^with 
Ms. Jane Bl^k witih respect to surveying her teachers at 
a faculty meeting and she was quite amenatolew^ Xn return, 
we Will provide Ms Blank with feedback with respect to 
the responses of her faculty. ^Also, I promise you, as 
i did her r that ho mention of any of . tiie individuals in 

i th^ study, of the schools ih question, or taieir location, 
proximate or general, will he made. I am haf^ to thank 
you for your cooperation in tixis important investigation. 



Dr^ John Roe 



Assistant Director of Special Education 

Utopia County - 

ErevAion, : New York 



Dear Dr. Roe: 




e 



Sincerely yours. 



KFG/pm 



Kurt P. Geisihger, Ph.D. 
Assistant Professor 
Project Direct 
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BACKGROUND . INFORMATION 



1. 

2. 



4. 



S. 



Sex: 
Age: 



Male^ 

20-29 

30-39" 

40-49' 



Ethnic group: . ^: 
White fother than Hispanic!- 
Black— ' Oriental;, 
OtherTfTease , specify} I 



Female 

50-5-9- 
60 S up 



Hispanic 
American Inoian__ 



Your present educational baacground (cheW highest appropriate level) 

High school + further training_^f. \ 

Hachelor's degree - : . . 

Bachelor's degree + graduate training — _^ 

SS«?:| Sirll^^urthir graduate .training__ ' . . 

Doctoral degree W ; « 

Your training: in educational and/ or psychological testing (check one 

;iladua?.'!Kll-ourse__ W^^^SSiS^-^ 
,:uiidergraduate-level course_^ No formal training__ _ 



6. Yotxr current job, title: 



Do you work directly with, students? 
If yes, answer 8, 9* and 10 below. 



Yes 



No 



8. With what grade leVelCs) of students do you work? - 



9. What is the total number bf,^udents with whom yog, hav e classroom br 

othey proSessiohal contact^ _ — r 

19. Of th.se. approximately hW many afe members of each of the; following 

ethnic, groups: ^ , , Hicnanic ^ 

WEi«Jotlx«tha„Hxs||«=l_ ■^||gS-T5l„„_ 

Other'TJTease specify) ; — — " " 



ERIC 



?i63'Se circle 
in the activit 
achievement , b 



widely used te 

learned subjec 
batteries , tes 
history^ etc. 
itYypurself o 
Re;!ienfa3r, this 
same questions 

Activity 
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TEST ACTIVITIES INVENTORY 

' **;PART I: ACHIEVEMENT ^ESTS** 

the frequency of your participation in your present capacity 
ies listed below. Answer withl respect to standardized , 
r subject matter tests . Standardized tests are uniform ^ 
sts ai distinguished from ^ tes ta made by te achers ^ for us e ^ 
lasses. Achievement tests meastire how well children have 
t matter taught in school ; examples include acjiievemeht 
ts of basic sicills in reading or mathematics ^ tes^s in 

Respond to ^each activity if you either perform tl^^^ 
r serve as a member of a conni^ performing that activity, 
part concerns achievenent tests; you wiii be asked the 
about: mental ability tests in Part II oh page 4,. 



Authorize the introduction of 

the testing program in your schoolfs)' 

Select a - test from s eve rjJL 
tests for^ use at- your school (s) 

Cpbrdinate and manage the t^esting 
program 

Dfecide oh the continued employment 
of the testing prograin at your 
school Cs) 

Orient students to take tests 

Administer tests to students 

Receive- the test scores 

Have access to these test scores 
(when not received directly) 

Use test scores in helping- to 
understand students 

Use test scores. in planning and 
adapting instruct ion 

Use test scores for grouping . 
: children for instructional-purposes 

Use test scpresto evaluate perform 
ance (of individual students , classes, 
programs, and ihstructioh) 

Use test scores to identify children 
with special needs 

Counsel or instruct students regard- 
ing the , meaning, o^f their test;, scores 



. x^requency 
Ceircie one for' each activity) 
Regularly Occasionally Never 



Regularly Occasionally Never ^ 



Regularly 
Regularly 
Regularly 

Regularly 

Regularly 

Regularly 

N^egularly 

\. ; 

Reg^arly 

Regularly 



Regularly Occasionally Never 



Regularly Occasionally Never 



Regularly Occasionally Never 



Occasionally Never 
Occasionaliy Never 
Occasionally^ Never / 



Occasionally Never 



Occasionally Never 



Occasionally Never 



Occasionally Never 



Occasionally.'- Never 



Occasionally- Never 



Continue on • the next page 
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Act4yity 

Explain the meaning^of these^test 
scores to parents or to teachers or 
other school personnel 

Use the test scores in some other 
manner Gplease specify belowD 



grequehcy 
Regularly . Occasionally Never 

r 

Regularly Occasionally Never 



tlieir xisefulness • 



Not at ail 
Useful. 



Mildly 
Us eful 



Modern -ely 
Uie^ul 



Quite 
Useful 



Highly 
Usefiil 



4 ' 



8 



f; What could be done to Sake ttese tests more useful to ypu^ 
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TEST AetiVITIES INVENTORY * 
**PART II: MENTAL ABILITY TESTS** 



Part II of this invehtbry deals with the standardized itifental ability tes^s 
Mental ability tests are, often referred to as tests of intelligence ,^ 
general aptitudej academic potential, _or school readiness: The questions 
below are the same as those you answered in PART I.^ Pl^ease circle, the 
frequency of your participation in your present capacity in the activi- 
ties listed below. .Respond to each activity if y^ 

2-ctivity yourseif or serve as a member of a committee performing that 
.activity* 1! 



Activi ty ^ 

Authorize the introduction of the 
testing program in your schoolGs) 

Select a test from several - 
tests for use at your school (s) 

Coordinate and manage the test- 
ing program 

Decide on the continued employment 
of the testings-program at your 
school(s) 

Orient students to take tests 
•Administer tests to students 
Receive the test scores 



Have access to these test scores 
(when not received directly) 

Use test scores in helping to 
understand ^students 

Use test scores in planning and 
itihg instruction 



\ Use test scores for grouping 
\ children for instructional purposes 



tJse test scores to evaluate perform^ 
ance (of individual students, 
classes, programs, and instruction) 

Use tesl: scores to identify 
children with special needs 



(Circle one for each activity) 



Regularly 
Regularly 
Regularly 
Regularly 

Regularly 
Regul arly 
Regularly 
Regularly 

Regularly 

Reguiariy 



Occasionally 
Occasionally 
Occasionally 
Occasionally 

Occasionally 
Occasionally 
Occasionally 
Occasionally 

Occasionally 
Occasionally 



Regular ly\^ Occasionally 
Reguiariy 0t:;cas ional ly 



Never 
Never 
Never 
Never 

Never 
Never 
Never 
Never 

Neyer 

Never 

Never 

Never 



Regularly Occasionally Never 



Continue oh next page 
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Activity 

Counsel or instruct students . 
regarding the meaning of their 
test scores 

Explain the meaning of these test 
scores to parents pr_to teachers ^or 
other school personnel . 

Use the test scores in some other 
manner [please sijecify below) 



Frequency 

Regularly Occasionally Never 

Regularly Occasionally Never 

Regularly Occasipnaiiy Never 



ts 



in your work? Circle 
of their usefulness. 



Not' at all 
Useful 



Mildly 
Useful 



Moderately 
Useful 



Quite 
Useful 



Highly 
Useful 



1 2 3 4 ,5 6 : 7 8 

What could be done to make these tests more useful to youf 



3 Please name one or jndxe specific examples of standardized mental 
ability Ssts with which you have recently been involved. 
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TEST OPINION INVENTORY 



Please circle the humbef which corresponds to the extent to which you 
agree or disagree with the statements below. 

Strdhgly Strongly 
Disagree ?^ Agree 

is Givi-ng meStai ability 

' ("intelligence''^ tests . 
would imprpye the effective- 
ness of instruction. 1 2 3 4 5 6 7 8 9 

2. The attempt to measure human 
behayior_ Ci*6*_attitu^ 
achievement, aptitude, per- 
sdhaiity, etc;} is an insult 

tO; hximah dignity. 1 2 3 4 5 6 7 8 9.. 

3. in admitting students, ; 
colleges should give more 
weight ta_perspnalinte 

views than to test scores. 1 2 3 4 5 6 7 8 9 

4.. Testing is tod widespread 

in our society. 1 2 3 4 5 6 7 8 9 

■ *" • ' ■ ■ 

5. "i;Q." tests are quite help- 
ful in making iristtuctional 

decisidns about students. 12 3456789 

6. Tests designed td- predict how 

well children will dd _in_ 

school tend to underestimate 
the school achievement of 

minority children. 12 3 4 5 6 7 8 9 

7. Scores on standardized read- 
ing tests are an important 

^ , aid td teachers. . 123 4 56789 

8. Most achievement tests assess 
mainly rote memdry for unim- 
portant details rather than / . : 

true understanding. 123456789 

9. \Tests can assess impartially 
a child's knowledge and re^ 
veal talent, because they are 
hdt affected by the child's 
appearance, clothing, or 

manners. 12 3 4 5 6 7 8 9 
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Strongiy 
Disagree 



Strongly 
. Agree 



Id. tests help to identify _ 
specific cultural handi-_ 
caps as a necessary fi|*st 
step in planning remedial 
action. 



11 



Most tests of "mental" OTT 
"scholastic" ability have 
been builtin such a way _ 
as to discriminate against 
minority children. 

12. The educatidiai system would 
be better of^ if all stand- ^ 
ardized testing were elimi- 
nated. 

13. Standardized tests with 
national norms are undesxr- ; 
able because_they encouirage 
comparison and competition 
with others ihsteadof focus- 
ing on the imprqvcsment of 

, diie's own performance. 

14. there are so many abilities 
and characteristics relevant 
to school performance that_ 
assessing only one or two of 
these characteristics does 
more harm than good. \ 

is. When properly used,^tests can 
serve an important function in 
preventing irrelevant ^nd un-. 
fair discrimination. 



7 



r 8 
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Instruct ions : Tlie questions below_are concerned with how. test scores 
are actually used and interpreted in dealing with schoolchildren. 
Please respond to every que^tipnby circling your preferred answer. 
If for any question you are not sure which answer to choose, please 
circle"e"CDon' t Know); 

1. On "a_ certain test,; it was fotmd that a child^s score is likely 
to change by a few points when the child is retested at differ- 
ent times of with dif fefent forms of the test. The best way to 
handle this iituation is to: __; 

a. retest and report the second sccjre. 

b. retest and report the higher score. 

c. test once and report a likely range, for each child. 

d. ignore the test because It is unreliable and cannot be 
' trusted^ 

e . Don ' t Know 

2.. Sally^ a^fpufth'grade childj e 98 on a nation- 

ally standardized, mental aptitude test. IVhat is the best 
interpretationof this score?. _ 

a. Sally completed nearly all items correctly. 

b. Sally is agprdximately average in_gene 

c. Sally has the capacity currently to perform far beyond 
the typical foiarth- grade level. 

d. Sally's score is meaningless until we know the test norms. 

e. Don't Know 

S. A school district has developed a criterion- referenced reading 
^ test. _ Which d£_ the f pi would best represent the fact 

that the test is valuable? 

a. The test-retest reliability of the test is high. , 

b. A vast majority of the students; pass the test . 

c. A significant portion of the j^tudents fail the test. 

d. The test accurately reflects "reading competence. 

e. Don' t Know ' , 

4. Grade- equivalent test scores can best be described asj 

a. scores which assign a letter grade CA^ D^ F5 to the 
child's performance. __ ^ ; 

b. scores which correspond to letter grades earned in, school. 

c. scores which compare individual test scores to norms for 
each grade. 

d. scores which ar^ based on the school grade in which the 
child is currently enrolled. 

e. Don' t Know 

5. On a 100 -item aptitude test, the average number correct for 10- 
year-olds is 85. The number 85 can be best designated as a: 

a. mode ' 

b . norm , _ 

c. standard score 

d. percentile score 

e. Don't Know 
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b. 
c. 

•d. 



A student is not achieving well in school. She is^iven an^^ 
intel-ligehce test and earns an extremely high iQ- Wh^cn ot tne ^ 
fblloiiirbest describes your interpretation ,o£ the situation 

f ' ?gSe'?rprobabl|"o|ething wrong with the intelligence test 

' m !ral'lSMlhfim."^S^''Jig'^titude-shm 

cussel Sth her and she should be "^g^^^to^^ork harder. _ 
More information abqut her should bf gathered in the attempt 
to understand why .she is iio*,-»?^^^T^5g^weli. referred 
She probably has an .emotional problem and should be reterrea 
to a school psychologist, 
e . Don ' t Know 

Of the following measuresi which would^you =°5|i«ig.f|f ^^^"^ 
^t, ^i==i« rhe riadiae readiness of a first-grade childr^ 
>a° TI"tS^ffii^sFfEit-7eveals innate ability unaffected 
by past experience. _ __. ^ 

analysis of the reading process ^ 
d. a test of basic attitudes and motivation 
e! Don't Know 

If 30 percent of black children reach or exceed the m^ 

white median is: 

a. 15. 

b. 30. 

c. 50. 

d. 70. 

e. Don't Know 

In standardi2:ed ability tests, norms are most often established 

by: ^ . ^ ^ . ' 

a. testing a representative group. 

b. conducting controlled experiments. — 

c. applying psychological theory, 
d; obtaining consensiis of experts, 
e. Don't Know 

. c tilulS llf al«ct the child's icore on a prop.rly constructed 

d. Sirb5:|utgrow"ifter the child is placed in a normal school 
environment. 

e. Don't iSiow 
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Standard scores canbe most accurately described as test scores 

a. obtained under standard testing conditions; 

b. obtained with standardized tests 

c. evaluated in terms' of an objective stauida^^ 

d. expressed in terms of standard deviation units . 

e. Don't Know . 



In general^ what do mental ability test^^ - 

a. current level of intellectual performance > 

b. test-taking abilities and skills 

c. underlying capacity for mental ftmctip^ 

d. ' the speed of manipulating abstract concepts 

e. Don't Know 

IfDebby receives a peycentile score of 70 on a standardized 
achievement test., which^ of the following conclusions is more 
likely to be true2__. ' _ 

SL. She answered 70% of the items cprreqtly. 

^- H©? perforinance was clearly better than average. 

c. Her performance was clearly poorer than average. 

d. Her performance was just about average. 

e. Dbh' t Know 

llie term ''reliability'' refers primarily to yg'hich of the follow- 
ing characteristics of test scores? ^^.-^^ 

a. consistency ^ 

b. obiectivity 

c. accuracy 

d. variability 

e . Don ' t Know 

If a boy earned a grade- equivalent score of 3.5 on a reading 
test ^ it means that i : : ^ 

a. he reads about average for children of his age. 

b. he had three questions correct and one partially correct. 

c. his performance rates a B+. 

d. , her. reads about as well as an average mid-year third-grader, 
e • Don ' t Know 
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Strongly 
Disagree 

lb. tests Jielp' to identify _ 
specific cultural handi- 
caps as. a necessary first 
step in planning remedial - ^ 

action. ' ; 

11. Host tests of "mental" or 
"scholastic" ability have 
been built in such a way 
as to discriminate against _ 
minority children. : 

12 The educational system would 
be better off if ail stand- 
ardized testing were elimx- ^ 
nated. 

13. Standardized tests with _ 
national norms are tmdesxr- 
able because they encourage 
comparison and competition^ 
with others instead of focus- 
ing on the improvement of _ , 
one's own performance. i 

14 there are so many p.bilities 
and characteristics relevant 
to school performance that _ 
assessing only one or two of 
V.ese characteristics does _ 
more harm than good- ■'■ ' 

IS- ;«ieh properly used, ^tests can 
serve an important function in 
preventing irrelevant and un- _ 
fair discrimination. 



.11 



Strongly 
Agree 
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, related to the testing_progjam,^g) h^^^^ and receives infor- 

schodl district, and C4) how^he^?je^||*^g test publishers , 
mation from f °Pl%|f J^tle^nd flleS govlrnments) . Explain 

^ar^s oS'gJ^? o| If ^^^^^^ 

liiSi JXJr!c?«;m-be'!S5ti^S^^'sntertain .ue.tions. 



OescriEtion^ the progrp ^sk him/her^ g d^cribg^^ 

^ prHg^SST^ IvfSat grade levels ^^!.|f||^fe:g » by guidance .cbun- 

Sther testing. goes °»,JSi^^|/^||rs^ltl! Itc.)? What are his/ 
&:i°^Sial!^IsJiP^S°^^SI1er^^Lll/organization^ 



The Rationale of the Program : Ask for what purpose each test m 
this programnTs being given Ce-g., Title I evaluation, evalua^ 

tion of teachers, evaluation of students'" progress, ability 

grouping, etc,) 



Grouping of GhAld^en : Query the coordinator as to whether their 

district groups children. If s6_, to what eateiit are test 

scores used in this decision? What other information is used 
in conjunction with_ the test scores Ce.g., parents', teachers* 
or counselors' comments)? 



teachers ' Use of Test Scores ; Do the teachers directly/receive the 

test scoreF FiTheir students? If not, do they ha^e access to 

them? 



If 50, in What ways do _ they think_the_teachers use /the^scoresr ^ 
in eeheral, what is the coordinator ' s impression of the quality 
of decision making by teachers?_ Does he/she_feel teachers are 
able to use tests for the benefit of instruction? 
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thai effect? , * 



<3> 



If th, coordinator states that gacyrs ^^use^tes^^^^^ 
scores, first n»ake ^ certaxn_t^e/she knows adapting- 
about Ce.g., SroupxngJ^xl^ edSaSional pllns for children) . 



1 



Sttituleswiih those of these other groups? 
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The Role o£ the CdardiTTator : To what extent is he/sKe an autonomous 

ae^sToiTHralcer? [TTTustrate decisions as his/her choice of 

*^tests^ orienting the program, etc.}. • ^ 



Who dise is chief iy/paftially involved in making decisions? 
As a decision-case in point i_ if _ they have changed tests in the 
past five years'^ for what reasons^ did they make- the change 
and , who was involved in the decision?^ 



To what extent is : he/she ehciMberedbyfinancial considerations? 
If he/she had more money, what would .he/she do with it? 



What infonnation does he/she use in making testing decxsxons 
Ce,g., Buros, informatiph_from test publishe consultants)? 
Where does he/she get this information? 
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-I ; 

L/ike to 
Itly 



receive 
feceiving": 



How does 



he/shei feel tests should^ "be changed? 
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Barent Sarvby 

this Questionnaire was designed so that we might learn about parents ' 

e^eriences with l?Sdardized teiting in the schools and their opinxons 
IS?S ISch testing. Please read carefully |"JJJ"^',^|/J^i 
thS directions. If anything is not clear, do not hesitate to ask for 
assistance. ' 

Answer the" questions on this paj.e either by checking the appropriate 
space oriy JSiting, in the ansT^er. Wh^n you have finished this page, con- 
tinue with the rest\^o£ the questionnaire. 



£1) Sex: Male 



_ V 



C2). Age: 20-29 — 
30-39 

(3D Ethnic background: 



Feinale_ 

40-49_ 
50-59 



60 5 up_ 



White pother than^Hispanic)^ 
Black — Oqriental- 



Hispanic^ 
American Indian 



Other (please speci\fy)^ 



(4) How many of your children attend school? 
What are their ages? — _ 



(5) How many o£ your children attend public schools* 

How many of your children attend parochial schools-?..... 
Hbw many o£ your children attend other kinds of private 
schools? • • • • 



AJ:tx tildes Re^ardtn^ Achieyement and Mental Ability Tests 



. We are trying tc find q parents think abqut the use of 
standardized achievement and mental ability tests for schbolchil- 
dren. Achievement tests measure how well children have learned 
subject matter taught in school; examples include achievement bat- 
teries and tests of specific subifcts such readings math, and 

social studies. In contrast, mental ability tests can be illustrated 
by intelligence tests and tests of scno±astxc aptitude. 

1. Qh the scale below, circle the number which best indicates how 



you feel about the use of achievement tests for schoolchildren. 

strongly strongly 
disapprove neutral approve 

1.2 3 4 S 6 7 8 9 

2. On thl:- scale, circle the one number wiy.ch best indicates how 

ycu fe:^l about the use of mentat ab ility teats for schoolchildren. 

strongly strongly 

disapprove neutral . approve 

1 2 3 4 S 6 7 8. 9 



Items 2[-12 describe p63»ible kinds of decisions that might be made 



about children on the ba^r^ of their achieyeme^ 
test scores. For each item, circle the number on the scale which 
indicates how you feel about the use of test scores in making such 
decisions. 



3. Hake tracking decisions (for example, assigning children to ; 
fast or slow classes , academy or vocational curricula] oh the 
basis o£ achi svement test scores . 

strongly strongly 
disapprove . neutral approve 

1 2 3 4 5 6 7 8 9 



4. Make tracking decisions on the basis of mental ability test scores 

strongly \ strongly 

disapprove neutral approve 

1 2 3 4 5 6 7 8 9 
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S. Give extra instruction in some Object area as a result. o£ 
Achievement test scores . 

, strongly 

strongly ; . ^ ^ approve 

disapprove neutraj. rr 

-.123 4 S 6 7 8 9 



6 Give e:ctra instruction in some subject area as a result o£ 
i^ntal ability tes% scores . 



. • dlsapp?o^e neutral " 'apprSve 

. 1 2 3 4 5 6 7 8 9 

7. Influence children's career plans on the basis o£ achievement 
test^ scores . 

• , strongly 

strongly „«„i,ral approve 

disapprove neutral ff 

.1 2 3 4 ' 5 6 ^ ^ ^ 

8. Influence children's career plans on the basis of mental ability 
. test scores , 

, s-trqngly 

^trongly neutral approve 

disapprove neurrax , 

1 2 3 4 5 6 7 8 9 

9. idintify intellectually gifted children on the basis^ of achievement 
test scores . 

, ' strongly 

strongly neutral approve r 

disapprove neutraj. ft- 

1 2 3 4 5 6 .7 8 9 

id. Identify intillectuaHy gifted children on the basis of 
inehtai ahility test scores . 

, ' strongly 

^strongly . neutral approve 

disapprove neutraj. er 

1 2 3 4 5 6: 7 8 9 
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li. identify children with learning disabilities oh the basis of 
achievement test scores , 

strongly strongly 

disapprove neutral approve 

i .2 3 4 S 6 7 8 9 



i2. Identify^ children with disabilities on the basis of 
Bientai ability test scores . 

strongly ^ strpngly 

disapprove neutral approve 

1 2 3 4 5 6 7 8 9 



13. Are either achievement or mental ability tests actually being 
used in your (diild^s school to ma of the following deci-- 

s ions? For each_ decision listed below, check one of the three 
spaces in the achievement test cdlnihn and one of the three spaces 
in the mental ability test column. « 

Achievement Tests Mental Ability Tests 
_ Boh ^ t Don.' t 

Decisibh Yes No Know Yes No Know 

Make tracking decisions ^ - -- 

Give extra instruction 

in some subject area — - — ■ - — . ' 

Influence children's * 

career plans -- • 

Identify gifted chiI4reh > J 

Identify children with . - 
learning disabilities ^ 



14. Do you believe other kinds of decisibhs are made about school - 
children on the basis of their achievement test scores ? If so, 
please give one or two examples and express your opinion about 
them. . 
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15 Do you believe ot&er kinds o£ decisions are made about s chop 1- 
children on t&e bksis o£ their mental ability test sco^e^? |£ 
ft please give one or two exaipTes-and express your opinion 



about them. 



16. On this scale, circle the numberwhich best indicates ho^ 

|eel about yoir children being given an achievement test m 
schddl. 

^ , strongly 

disapp?o^e neutral ^PProve 

X 4 5 6 7 8 9 



17 using this scale, circle the number which best indicates how tou 
flel aSout your children being given a mental ability tes^ m 
school. - . 

strongly 



disapp^o^e - neutral approve 

. t A <; 6 7 8.9 



18 . Would :you prefer that your children receive either more or less 
achievement testing in school? 

latisfied with . ^ 
More Less , present amount . Not sure^ 



Why do you feel this wayl 



o 
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19. Would you prefer 'that your children receive either more or less 
mental ability testing in school? ^ /' 



' Satisfied with , * 

More . - Less^ present amount ' Not sure 



Why do you feel this way? 



20. Hare you received any Infaxyation about the performance of your 
children on standardized achievement or mental ability tests 
given in school? 

YES NO 

Achievement tesits 



Mental Ability test^ 



If you have never received' any information about yotxx children * s test 
performance y omit questions 21 through 24* and go on to page 9. 

If you have received information, answer questions 21 through 24. (If 
you have received information on more than one occasion, amswer with 
respect to the most recent information you have received.) 



21. Did you have to ask for the information from a teacher or other 
school official or did your receive it without asking? 

HAD TO ASK WITHOUT ASKING 

Achievement tests ' ■ •. 



Mental Ability tests 
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Hdw was the information given to ypu? Please check the. statem^n^ 
o? statements which best'^describe how you received the information 
for each type of test. 

■ ACHIEVEMENT MENTAL ' ABILITY 
TESTS TESTS 

In an individual conference with 

a teacher . - 

in ah indiyiduai conference witE 

another sch-ddl of ficiai; ..i » • ■■ • • ■ " 

In a group meeting, of parents 

with someone from the school.... - — — 

In a letter from a teacher ^ 

in a letter from another school 

official. .............. i i • ^ ^ 

In a test score report without 

explanation i . ^ ^ 



In a test score report with 
explanation. • • • • 

Ill a_ spoken message from the 
teacher delivered by your child. 

In an informal conversation with 
your child. • . i 



^ . • . 



In some other way Cplease speci- 
fy below) ................ — • • • ■ 
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23. vCircle: the ntunber below that best indicates -tcW useful yc' fqxind 
■/'the . achievement test informatibri. 

compieteiy fairly exii^^:':y: 
useless , , . useful : ur?.£^. L 

. 1 . 2 '3 / 4 5 .:6 '783 

24. Circle the number below that best indicates how u^e< i-. yvu found 
the mental ability test information. 

completely fairly extremf ly 

useless • useful U5<'ul 

• 1 2 3 1 4 5 6 7 8 9 

I,. . * . . 

25. What do you believe the school or teacher might have done to 
better inform you abot;^; yr?ur child's test performance? 



w • ' ' ' : ■ "~ 

26. Circle the humbsr below that best indicates the effect that the 
experience of taking achievement tests has on your child. 

quite _ no quite 

harmful ■ ^ effect helpful 



27. Circle the number below that best indica effect that the 

experience of taking mental ability ^ests has on your, child. ' 

quite no - quite 

harmful effect . helpful 



The final section of this survey is cohcerhed with your general 
opinions about testing* Turn to page 9 and complete the 
questionnaire. 
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TEST OPINION INVENTORY 



Please circle the ivumber which corresponds to th 
iiree or disagree with the statements below^ 



V" 



Strongly 
Disagree 



1. \ Giving mental ability 
—-^f "intelligence") treats 

Wuld' improve. ithe effective- 
less of iristrtictioiv. 



2. 



1' 



T&e attemp-t to measure human 
bbhavioT Ci-e. attitudes ^ 
a&ievementiagtitude , ^per- 
sbkaid^irnflcT) « an insult 
toThuiaan dignity- 

in adSitting students^^ 
colleges should give more 
weight toppers onal inter- 
vieWk than to test scores* 



Testing is too widespread 
in bur society. 

"I.Qi*\ tests are quite help- 
ful 4n\ making instructional 
decisions ^about students. 

fests designed to 7pred^^ how 
well children willdo in 
school tend to tjnderestxmate 
the school achievement of 
minority\ children. 

Scores pA standardized rcsad^ 
ing tests are ah important 
aid to teachers. 

Most achievement tests assess 
mainly_rate memory for unim- 
portant derails rather than, 
true understanding. 

Tests "can assess imp art ialiy 
a child's knowledge and re- 
veal talent^ because they are 
not affected by the child/s 
appearance, clothing, or 
manners. 



3 
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Strongly 
Dis agree 



10. Tests help to identify 
specific cultural handi- 
caps as a necessary first 
step in planning remedial 
action. 

11.. Most tests of "mental" or 
"scholastic" abiilty have 
been built in such a way ' 
. as to discriminai^e against 
minority children • 

12. The educational system wbiild 
be better off if all stand- 
ardized testing were elimi- 
nated. 



1 2 3 



13. Standardized tests wit^^ 

national norasare^T^ 

able because they encourage 
comparison and competition 
with others instead of focus- 
ing on the improvement of 
one! s. own performance. 1 2 3 

14. There are so many abilities. ^ 

and characteristics ^r^ / 
V to school performftnce that 

assessing only one or two of 

these dbiaracteristics does 
\ more harm than good. 12 3 

IS; Wfien properly used^ tests can 
! S erve an important ftmction in 
\ preventing irrelevant and un- 
fa- ? tt<! scrinihatioh. 12 3 



Strongly 
Agree 



6 7 8 3 



6 7 8 9 



'6 7 8 ■ 9 y 



6 7 3 9 



6 7 I 8 S 



6 71 8 9 
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